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SUMMARY 


The  DSN  project  at  Al&'DS  is  concerned  with  the  formation  and  evaluation 
of  hypotheses  for  situation  assessment  in  a  distributed  manner  by  the  processing 
nodes  in  a  DSN.  In  particular,  the  tracking  and  classification  of  multiple 
targets  is  chosen  to  understand  the  basic  technical  issues  since  the  uncertain 
origin  of  the  measurements  for  such  problems  requires  the  formation  of  data 
association  hypotheses.  Our  approach  involves  the  use  of  techniques  from 
both  estimation  theory  and  artificial  intelligence. 

Little  has  been  done  on  distributed  multitarget  tracking  and  classification. 
Even  in  the  centralized  case,  the  existing  results  are  not  really  good  enough 
to  provide  a  sound  foundation  for  developing  distributed  techniques.  We  have 
thus  investigated  the  centralized  multitarget  tracking  problem.  This  report 
contains  a  general  theory  for  multitarget  tracking  and  classlflciation  using  a 
Bayesian  estimation-theoretic  approach.  The  models  assumed  are  very  general 
and  are  capable  of  handling  complex  situations  such  as  targets  moving  in  groups 
or  sensors  with  a  limited  field  of  view.  When  specialized  to  Independent, 
identically  distributed  target  models,  which  are  more  widely  studied,  the 
theory  yields  algorithms  which  are  similar  to,  but  more  general  than  other 
existing  algorithms.  The  various  terms  in  the  evaluation  algorithm  have 
intuitive  explanations  which  reflect  the  target  and  sensor  characteristics. 

For  the  practical  implementation  of  this  algorithm,  hypothesis  management 
techniques  (pruning,  combining,  etc.)  have  to  be  used  to  control  the  rapid 
growth  in  the  number  of  hypotheses.  Some  new  techniques  are  proposed,  but 
a  basic  theory  is  still  lacking.  This  is  an  area  where  ideas  from  artificial 
intelligence  can  be  useful. 
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All  this  has  been  Implemented  In  a  system  called  the  Generalized 
Tracker /Classifier  (GTC) .  It  contains  the  following  four  on-line  modules. 

The  hypothesis  formation  module  generates  the  data-to-data  association 
hypothesis  which  identifies  the  data  reported  at  different  times  from 
different  sensors  with  the  same  targets.  The  hypothesis  evaluation  module 
evaluates  the  probability  of  each  hypothesis  given  the  information  available. 

We  have  developed  recursive  evaluation  formulae  which  reduce  to  the  standard 
formulae  in  the  literature  under  simplifying  assumptions.  The  filtering  and 
parameter  estimation  module  solves  the  tracking  and  classification  problem 
given  a  particular  data-assoclatlon  hypothesis.  If  the  targets  are  Independent 
and  identically  distributed,  then  the  algorithm  decomposes  into  a  parallel 
bank  of  single  target  algorithms.  The  hypothesis  management  module  controls 
the  (asymptotically)  exponential  growth  in  the  number  of  hypotheses. 

The  GTC  can  be  used  by  Itself  for  centralized  multitarget  tracking  and 
classification.  It  is  also  used  to  process  the  local  sensor  data  at  a  node 
and,  together  with  other  modules  for  Information  distribution  and  fusion,  is 
a  basic  component  of  each  processing  node  in  the  DSN.  This  will  be  reported 
in  a  subsequent  report. 

Simulation  runs  for  a  scenario  with  terrain  masking  of  targets  are  used 
to  demonstrate  the  hypothesis  management  techniques  and  the  general  feature 
of  the  GTC. 
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1 .  INTRODUCTION 


The  distributed  hypothesis  formation  in  DSN  project  at  Al&DS  is  concerned 
with  the  formation  and  evaluation  of  hypotheses  for  situation  assessment  in  a 
distributed  manner  at  the  processing  nodes  in  a  DSN.  The  basic  system  model 
assumes  the  presence  of  a  distributed  system  of  sensor/processing  nodes,  that 
nodes  have  one  or  more  sensor  types,  have  overlapping  sensor  coverage  and  are 
connected  in  a  packet  switching  network.  The  input  information  at  each  node 
consists  of : 

-  own  sensor  information 

-  neighbor  nodes  hyotheses 

-  contextual  information 

While  the  system  can  also  be  used  for  distributed  planning  and  control 
(see  Figure  1-1),  our  focus  in  this  project  is  on  distributed  situation 
assessment.  Our  main  thrust  is  to  understand  the  technical  issues  for  such 
distributed  systems  through  the  analysis  of  idealized  problems  using  tech¬ 
niques  from  both  estimation  theory  and  artificial  intelligence. 

One  area  where  a  DSN  is  useful  is  the  tracking  and  classification  of  mul¬ 
tiple  targets.  We  have  chosen  this  problem  as  a  vehicle  for  understanding  the 
basic  issues.  Despite  the  obvious  importance  of  this  problem  and  some  applied 
work  [1],  very  little  has  been  done  towards  developing  a  theory  of  distributed 
multitarget  tracking  and  classification.  (Some  attempts  have  been  reported  in 
[2],  [3].)  Even  if  we  consider  only  the  centralized  case,  the  existing 
results  are  not  good  enough  to  form  a  basis  for  the  development  of  distributed 
algorithms.  We  thus  have  searched  for  a  better  theory  for  centralized  multi¬ 
target  tracking.  This  report  summarizes  the  results  of  our  investigation. 


EXTERNA!  EHVIROIKtEJIT 


The  multitarget  tracking  problem  arises  in  many  application  areas  such  as 
ocean  surveillance,  air  traffic  control  and  air  defense,  etc.  A  key  feature 
in  such  problems  is  that  the  origins  of  the  measurements  may  be  uncertain.  As 
a  result,  it  is  necessary  to  associate  the  measurements  with  the  target  tracks 
before  any  estimation  of  the  targets  can  be  performed.  Many  algorithms  for 
multitarget  tracking  have  been  suggested  [4]-[21].  Surveys  of  the  area  can  be 
found  in  the  survey  paper  by  Bar-Shalom  [22]  and  the  Naval  Ocean  Surveillance 
Correlation  Handbooks  [23], [24].  The  recent  paper  by  Reid  [20]  also  contains 
a  good  survey  of  the  then  existing  methods.  Thus  we  will  not  perform  a 
detailed  survey  here.  Most  of  the  existing  work  deals  with  approximate  algo¬ 
rithms  which  are  only  applicable  to  specific  situations.  There  have  been  some 
attempts  to  search  for  a  unified  theory  [25],  but  the  results  are  still  not 
very  satisfactory.  Reid's  paper  is  a  step  in  this  direction  and  has  motivated 
the  work  of  Keverian  and  Sandell  [18]. 

The  multitarget  tracking  problem  is  different  from  ordinary  estimation 
problems  in  that  the  origins  of  the  measurements  are  in  general  uncertain. 

In  other  words,  the  order  in  which  the  measurements  are  obtained  does  not  con¬ 
tain  any  information  about  their  relationship  to  the  targets.  Thus  the  meas¬ 
urements  should  really  be  considered  as  elements  in  a  set  rather  than  as  ele¬ 
ments  in  an  ordered  tuple  as  in  the  case  of  an  ordinary  estimation  problem. 

In  order  to  use  ordinary  estimation  techniques  for  multitarget  tracking,  one 
needs  first  to  hypothesize  the  origins  of  the  measurements.  These  hypotheses, 
however,  need  to  be  generated  in  real  time  and  cannot  be  specified  a  priori. 
The  problem  is  thus  different  from  ordinary  hypothesis  testing  where  the 
hypotheses  to  be  tested  are  usually  specified  before  hand.  This  introduces  a 
new  class  of  unconventional  estimation  problems  which  involves  combinatorics 
(for  generation  of  hypotheses),  hypothesis  testing  and  ordinary  estimation. 
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Hypothesis  management  ideas  which  are  important  in  artificial  intelligence  are 
also  needed. 


In  this  report  we  present  a  comprehensive  theory  on  multitarget  tracking 
and  classification  using  a  Bayesian  approach.  The  theory  is  based  on  fairly 
general  assumptions.  In  fact,  tracking  and  classification  can  be  considered 
simultaneously,  and  general  models  on  target  dynamics  and  sensors  can  be  han¬ 
dled.  Our  results  include  almost  all  existing  results  as  special  cases  when 
specific  models  are  used  and  simplifying  approximations  are  made.  Although 
the  results  are  theoretically  complete,  successful  implementation  requires 
good  hypothesis  management  techniques. 

Our  algorithm  has  been  implemented  in  a  system  called  the  General ized 
Tracker/Classif ier  (GTC),  which  has  the  structure  shown  in  Figure  1-2.  It 
consists  of  three  off-line  modules  and  four  on-line  modules.  The  three  off¬ 
line  modules  are: 

1.  generalized  target  dynamics  model 

2.  environmental  model 

3.  sensor  model 

These  are  used  in  the  design  and  selections  of  algorithms.  The  on-line 
modules  are: 

1.  hypothesis  formation 

2.  hypothesis  evaluation 

3.  filtering  and  parameter  estimation 

4.  hypothesis  management 
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Figure  1-2  Generalized  Tracker/Classifier 
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The  hypothesis  formation  module  generates  the  data-to-data  association 
hypothesis  which  identifies  the  data  reported  at  different  times  from  dif¬ 
ferent  sensors  with  the  same  targets.  The  hypothesis  eyaluation  module  evalu¬ 
ates  the  probability  of  each  hypothesis  given  the  information  available.  We 
have  developed  recursive  evaluation  formulae  which  reduce  to  the  standard  for¬ 
mulae  in  the  literature  under  simplifying  assumptions.  The  filtering  and 
parameter  estimation  module  solves  the  tracking  and  classification  problem 
given  a  particular  data-association  hypothesis.  If  the  targets  are  indepen¬ 
dent  and  identically  distributed,  then  the  algorithm  decomposes  into  a  paral¬ 
lel  bank  of  single  target  algorithms.  The  hypothesis  management  module  con¬ 
trols  the  (asymptotically)  exponential  growth  in  the  number  of  hypotheses. 

The  details  of  these  modules  are  described  in  the  remaining  sections  and  sum¬ 
marized  in  Section  8. 

The  GTC  can  be  used  by  itself  for  centralized  multitarget  tracking  and 
classification.  It  is  also  used  to  process  the  local  sensor  data  at  a  node 
and,  together  with  other  modules  for  information  distribution  and  fusion,  is  a 
basic  component  of  each  processing  node  in  the  DSN  [26].  The  details  will  be 
discussed  in  a  subsequent  report. 

The  structure  of  the  report  is  as  follows.  In  Section  2,  we  present  the 
general  target  and  sensor  models.  Section  3  introduces  the  definitions  of 
tracks  and  hypotheses  which  are  needed  in  the  multiple  hypotheses  approach. 

The  basic  hypothesis  evaluation  algorithm  applicable  to  the  general  target  and 
sensor  models  is  given  in  Section  4.  Section  5  considers  the  specialization 
of  this  hypothesis  evaluation  algorithm  to  independent,  identically  distri¬ 
buted  target  models.  The  relationship  of  these  results  to  the  other  existing 
algorithms  is  discussed  in  Section  6.  In  Section  7,  we  present  the  hypothesis 
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management  techniques  which  are  crucial  for  implementation.  The  implementa¬ 
tion  of  the  algorithm  in  the  form  of  the  Generalized  Tracker/Classifier  (GTC) 
is  discussed  in  Section  8.  Section  9  contains  an  example  to  illustrate  the 
use  of  the  GTC.  A  conclusion  is  given  in  Section  10. 
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2.  TARGET  AND  SENSOR  MODELS 


In  this  section  we  describe  the  target  and  sensor  ntodels  which  will  be 
assumed  for  the  derivation  of  the  general  results.  The  models  are  quite  gen¬ 
eral  and  include  almost  all  other  models  used  in  the  multitarget  tracking 
literature  that  the  authors  are  aware  of.  More  specific  models  for  a  class  of 
subproblems  will  appear  in  Section  5. 

2.1  Target  Model 

As  is  customary  in  the  mult:^target  tracking  literature,  a  target  is  used 
to  describe  any  object  to  be  tracked,  whether  it  is  a  friendly  or  enemy  vehi¬ 
cle.  In  the  general  model  described  below,  we  model  all  targets  which  may  be 
of  interest  ac  one  entity  rather  than  as  a  collection  of  individual  targets. 
Thus  the  state  of  all  targets  is  modeled  by  a  continuous-time  stochastic  pro¬ 
cess  (X,  N^),  taking  values  in  the  direct-sum  space 
00 

IJ  a  {n}.  (2.1) 

n=0 

is  an  integer-valued  random  variable  representing  the  total  number  of  tar¬ 
gets.  This  number  is  assumed  to  be  random  but  constant,  largely  to  reduce 
unnecessary  complexity.  Given  that  the  number  of  targets  is  n,  X  is  a  sto¬ 
chastic  process  taking  values  in  In  general,  X^  is  a  hybrid  set,  i.e.,  a 

direct  product  of  a  subset  of  an  Euclidean  space  (continuous  part)  and  a  fin¬ 
ite  set  (discrete  part).  This  is  to  allow  for  the  representation  of  targets 
with  both  continuous  and  discrete  states.  X  is  also  assumed  to  be  a  time- 
homogeneous  Markov  process.  To  complete  our  description,  we  assume  there 
exists  a  time  t^  before  which  no  sensor  data  is  available.  The  target  model 
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is  then  specified  by  the  a  priori  probability  density  (mass)  p(N^),  distribu¬ 
tion  p(dX^  |Nj),  and  the  transition  probability 
*■0 


(E;  X(t),At)  -  Prob  {X(t+At)cE! (X(t) ,N_)} 
T  *■ 


(2.2) 


defined  for  every  t  ^  ^  ^  every  measurable  set  E  in  .  We  use 

p(.)  to  denote  the  probability  density  (mass)  or  distribution  of  one  or  more 
random  variables.  What  we  mean  should  be  obvious  from  the  context. 


This  general  target  model  includes  the  case  where  the  targets  are  corre¬ 
lated,  such  as  when  they  are  moving  in  a  group.  A  special  case  of  interest 
which  will  be  discussed  in  Section  5  consists  of  independent  and  identically 
distributed  (i.i.d)  targets.  I.i.d  target  models  constitute  a  very  important 
subclass  of  target  models  since  they  describe  many  real-life  situations. 
Furthermore,  the  resulting  tracking  algorithm  is  relatively  easy  to  implement 
and  is  related  to  various  existing  tracking  techniques.  With  the  i.i.d. 
assumption,  we  can  replace  by  X®,  a  direct-product  space  of  the  identical 
hybrid  spaces  X.  The  continuous  part  of  X  corresponds  to  position,  velocity 
and  other  dynamics  parameters,  while  the  discrete  part  corresponds  to  the  tar¬ 
get  type,  maneuvering  mode,  communication  activity,  etc.  Likewise,  the  vari¬ 
ous  probability  distributions  and  the  transition  probability  (2.2)  can  also  be 
partitioned.  For  example,  (2.2)  can  now  be  replaced  by 

F(E;  x(t),  At)  -  Prob  {  x(t+At)eE|x(t)  )  (2.3) 

which  is  common  to  all  the  i.i.d.  targets. 


9 


2.2  Sensor  Model 


Let  S  >  }  be  the  set  of  sensors  vhich  generate  the  measurements 

from  the  targets.  For  each  scS,  let  the  measurements  take  value  in  the  set 
/g.  We  assume  to  be  a  hybrid  space  where  the  continuous  part  contains  the 
position  and/or  velocity  information  and  the  discrete  part  contains  feature 
type  reports.  A  data  set  or  sensor  report  is  the  set  of  data  which  a  sensor 
generates  at  a  given  time.  Formally,  a  data  set  is  a  random  element 
(y>Ni^,t,s)  in  the  set 

00 

LJ  LJ  ^  ^  X  {s}, 

seS  °  (2.4) 

which  means  that  the  data  set  from  sensor  s  at  time  t  consists  of  N 

m 

measurements  given  by  y  ■  ^yj,...,y{j  ). 

m 

Five  assumptions  are  made  with  respect  to  the  generation  of  these  data 

sets : 

Assumption  ^  (Known  exact  timing) 

The  time  at  which  any  data  set  is  generated  is  exactly 
known . 

Assumption  2  (Memoryless) 

There  is  no  memory  in  any  sensor  so  that  any  target 
state  density/distribution  conditioned  on  the  past 
data  sets  and  the  target  state  is  the  same  as  the  one 
conditioned  only  on  the  target  state. 


Assumption  2 

Any  measurement  in  any  data  set  from  any  one  sensor 
does  not  originate  from  two  or  more  targets. 

Assumption  4 

No  target  creates  two  or  more  measurements  in  any  data  set. 

Assumption  ^ 

The  order  of  measurements  in  a  data  set  contains  no 
information  about  the  targets. 

Assumptions  1  and  2  are  standard  in  filtering  problems  while  assumptions 
3  and  4  are  almost  standard  in  the  multitarget  tracking  literature.  Assump¬ 
tion  3  is  crucial  to  our  theoretical  development  and  reflects  the  random 
nature  about  the  origin  of  any  measurement.  In  some  situations,  the  sensor 
data  should  be  partitioned  so  that  these  assumptions  hold  or  at  least  are 
approximately  valid.  For  example,  the  measurements  from  a  radar  with  a  fixed 
scanning  pattern  over  an  area  may  contain  some  information  about  the  targets 
in  the  order  of  the  measurements.  In  such  a  case,  the  data  sets  should  be 
further  divided  so  that  the  measurement  order  does  not  contain  any  significant 
information.  By  doing  so,  we  do  not  need  the  notion  of  "type  1  sensors"  and 
"type  II  sensors"  which  were  loosely  defined  in  [20]. 

With  these  assumptions,  we  can  now  describe  our  sensor  model.  A  data  set 
(y,N^,t,8)  is  generated  through  the  following  four  steps. 

Detection; 

Let  5  be  the  detection  function.  Given  (X(t),N^), 

the  target  state  at  time  t,  6  is  a  random  binary  function 
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defined  on  a  set  {1 . N^}  as 


6(1) 


if  the  i-th  target  is  detected 
otherwise. 


(2.5) 


This  random  function  6  induces  a  set  (of  detected  targets) 

Ij,  -  |i  e  {  1, . . .  ,N^}  I  6(i)  -  1^.  (  f,) 

The  detection  model  is  completely  specified  by  the  conditional 
probability 

p(6lX(t),N.j.).  (2.7) 

Generation  ^  Number  of  False  Alarms : 


This  is  specified  by  the  conditional  probability 


p(N^|6,x(t),N^). 

Random  Assignment ; 

Let  0i  be  an  assignment  function  defined  on  and  taking  values 

in  the  set  {l,...,N  }.  a(i)  =  j  means  that  the  j-th  measurement  y  in 
m  j 

data  set  ((y^ . originates  from  the  i-th  target.  Thus, 

m 

with  A\B  as  the  difference  of  two  sets, 

“^FA  “  (1 1  •  •  •  .Njjj}\Image(ci) 


is  the  set  of  measurement  indices  corresponding  to  false  alarms  (or  measure¬ 
ments  not  originating  from  a  target).  According  to  assumptions  3,4,  and  5, 
should  be  one-to-one  with  probability  one  and  we  have 


p(0‘|M,.6,X(t),Nj)  -  P(cx|n^,6,Nj) 


*^FA* 


m 


(2.10) 
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for  each  a.  «FA*  the  number  of  false  alarms,  is  the  cardinality  of  the  set 

•^FA*  other  trords,  a  particular  ordering  of  the  data  (y^ . yjj  )  is  a 

m 

realisation  of  equally  likely  assignments  of  the  detected  targets  given  they 
have  been  determined  by 

Generation  of  Measurement  and  False  Alarm  Values 

This  Is  specified  by  the  conditional  probability  density 
p(y la,N^.6,x(t).N^)  (2.11) 

which  includes  the  measurement  error  model  as  well  as  the  model  of  the  false 
alarm  values . 

The  general  sensor  model  described  above  is  similar  to  the  usual 
measurement  equation  used  in  filtering  except  for  the  random  assignment 
function  which  results  from  the  unknown  origins  of  the  measurements  and  the 
random  detection  function  which  further  complicates  the  process.  This  is  the 
key  difference  between  ordinary  filtering  and  multitarget  tracking. 
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3.  TRACKS  AND  HYPOTHESES 


Tracks  and  hypotheses  are  among  the  most  frequently  used  terms  in  the 
multitarget  tracking  literature  since  there  is  a  need  to  associate  the  meas¬ 
urements  with  the  targets.  However,  in  most  cases  these  terms  have  not  been 
precisely  defined.  Our  definition  of  tracks  and  hypotheses  follows  closely 
Morefield's  notations  in  1 16],  but  differs  in  one  crucial  aspect,  namely,  the 
separation  of  the  measurement-value  information  from  the  number-of- 
measurements  information  in  each  data  set. 

We  assume  that  there  are  only  a  finite  number  of  data  sets.  Let 
{tj,t2,...,}  be  the  properly  ordered  set  of  times  at  which  the  data  sets  are 
generated  by  the  sensors.  Each  data  set  is  then  uniquely  identi¬ 

fied  by  the  pair  of  integers  (k,8).  We  may  thus  refer  to  a  data  set  by  its 
index  (k,8)  provided  that  a  sensor  is  not  allowed  to  produce  two  data  sets  at 
the  same  time.  For  each  data  set  (k,s),  a  measurement  index  set  is  given  by 

Ijii(k,8)  ■  {1, . N^}.  (3.1) 

A  lexicographic  order  ^  on  the  indices  is  defined  as 

1)  (k.s)  <  (k',8')  if  either  k  <  k'  or  (k  ■  k'  and  s  <  s'). 

2)  (k,8)  £(k',8')  if  either  (k,8)  <  (k',8')  or  (k,8)  ■  (k',8') 

The  cumulative  measurement  index  set  is  defined  as 

I  (k,8)  .  LJ  I  (k',8')  X  {(k',8')}.  (3.2) 

®  (k',8')l(k,s)  ® 
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The  cumulative  data  set  at  (k.s)  can  be  similarly  defined  as 


(k,s) 


u 


(k',s')£  (k.s) 


{ (y  (tk' ,  s' ) ,  K^(tj^,js’),  tj^ijs'}.  (3.3) 


Our  overall  approach  is  Bayesian,  i.e.,  we  would  like  to  compute 
p(dX(t ) ,N^ |z ® ^) ,  the  conditional  probability  of  the  target  state  given  all 
the  available  information.  Since  the  origins  of  the  measurements  are  uncertain, 
our  strategy  is  to  hypothesize  the  origins  of  the  measurements  and  use  these 
hypotheses  as  intermediate  variables  in  our  computation. 


Ue  define  a  track  T  at  (k,s)  to  be  a  nonempty  subset  of  the  cumulative 
measurement  index  set  A  data-to-data  association  hypothesis  X, 

(referred  to  simply  as  a  hypothesis  later  on)  at  (k,s)  is  a  (possibly  empty) 
set  of  track(s)  at  (k.s).  According  to  assumptions  3  and  4  in  Section  2,  any 
track  containing  two  or  more  measurement  indices  from  the  same  data  set  and 
any  hypothesis  with  overlapping  tracks  are  impossible  in  the  sense  that 

p(^j2(k,8))  , 

A  hypothesis  X=  at  (k,s)  should  be  interpreted  as  a 

hypothesized  event  which  states  that  n  targets  are  detected  in  one  or  more 
data  sets  up  to  (k.s)  and  is  the  set  of  measurement  indices  (together  with 
data  set  identification  (k',s'))  originating  from  the  i-th  detected  target. 
Thus,  for  example,  hypothesis  X  •  (t>  hypothesizes  that  all  the  measurements  up 
to  (k.s)  are  false  alarms. 


For  any  given  (k.s)  and  (k',8')  such  that  (k, s) >(k' , s' ) ,  we  call  a 
hypothesis  X  at  (k',8')  a  predecessor  of  a  hypothesis  X  at  (k,s) 
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if  each  track  t'  in  X'  is  a  restriction  of  a  track  t  in  X  to  I  \ 


i.e. ,  t'  ■  tHi 


(k'.s') 


and  each  track  T  in  X  is  either  the  extension 


of  a  track  t'  in  X'  to  or  ^  -  4).  If  (k',s')  is  the 

unique  immediate  predecessor  of  (k,s),  X*  is  called  the  parent  of  X. 

We  should  note  tnat  a  parent  of  a  hypothesis  X  is  uniquely  determined  by 
r  -  {tHi  e  X). 
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4.  RECURSIVE  BAYESIAN  EVALUATION  OF  HYPOTHESES 


(k  8 ) 

As  mentioned  before  our  strategy  is  to  calculate  p(dX(t),N^|Z  ’  )  using 

the  expansion 

p(dX(t),Nj|z^‘'*®^)  »  p(dX(t).Nj|X,Z^’‘’®^  pCXlz^’"'®^).  (4.1) 


Since  the  number  of  measurements  in  any  data  set  is  finite,  the  number  of  pos¬ 
sible  hypotheses  given  the  cumulative  data  set  is  also  finite.  Therefore,  at 
least  in  principle,  we  can  calculate  the  conditional  probability  of  the  target 
state  if  p(dX(t )  ,N.j,  1X,Z  ^ )  and  p(X|Z^^*®^)  are  evaluated.  In  this  section, 

we  shall  first  discuss  the  recursive  computation  of  p(XIZ^^’®^),  The  computa¬ 
tion  of  p(dX(t ) ,Nj|X ,Z ® ^ ) ,  which  is  also  necessary,  will  then  follow. 

4.1  Computation  of  p(X|z^^»^^) 

Let  the  current  data  set  be  »Njjj,tj^,s)  and  the  immediate  predecessor  of 
(k.s)  be  (k'.s').  To  simplify  the  notation,  we  denote  Z^^  \ 

(X(tj^)  ,N.j) ,  (X(tj^,),N^)  and  the  parent  of  a  hypothesis  X,  by  Z  ,  Z  ,  (X,N^), 
(X,N^)  and  X,  respectively. 

A  straightforward  application  of  Bayes  rule  gives  us  the  following  basic 
equation : 

p(Xlz)  -  p(^|z)  ^  (4,2) 

p(Z|Z) 

When  Z  ■  0,  we  have  4>  and  p(AtZ)  *  1  in  (4.2).  Since 
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p(X|z)  is  given  by  recursion  and  the  denominator  is  the  normalizing 
constant,  the  only  term  to  be  evaluated  is  pCZ.XjZ.X)  which  is  expanded 
as 


p(Z.Xlz,X) 


P(N^1Z,X) 


p(Z.X|x,N^.Z,X)  p(dX|N^.Z,X) 


(A. 3) 


where  the  integral  is  defined  with  respect  to  the  hybrid  probability  measure 
p(.  1n^,Z,X).  Both  p(N^|Z,T)  and  p(dxjN^,Z,X)  are  to  be  generated  by  recur¬ 
sion  in  Section  4.2,  and  can  be  used  to  compute  p(dX,N^|z,  X). 


On  the  other  hand,  p(Z ,X |X,N^,Z ,X)  in  (4.3)  can  be  further  expanded  as 


p(2,XiX,Nj,Z,X) 


E 

(a,f) 


p(y|a,N^,6,X,Nj,Z,X) 

p{X(a.N^,6,X,N^,Z,T) 

p(a|N^,6,X,N^,Z,I) 

p(N^|6,X,Nj,Z,X) 


p(6lX,H^,Z,X) 


(4.4) 


where  ol  and  6  are  the  assignment  and  detection  functions  defined  in  Section 

2, 


p(y  |a.Njjj,6,X,N^,Z,X)  -  p(yla,N^,6,X,N^), 

(4.5) 

p(N^l6,X.N.j.,Z,X)  -  p(N^|6,X,N^). 

(4.6) 

p(5lx,Nj,Z,'X)  -  p(6lX,N.j.) 

(4.7) 
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are  provided  by  the  measurement-error/false-alann  distribution  model,  the 
false-al arm-number  model  and  the  detection  model  respectively.  Also, 

P (a lNm,5 ,X,N^,Z ,^ )  is  given  by  (2.10)  in  Section  2  .  The 
remaining  term. 


p(X|a,N^,6,x,N.j.,2,X)  =  p(X  la,N„,6  ,Nt.,X  ) , 


(4.8) 


checks  the  consistency  between  X  and  (ci,N^,6 ,N^) ,  i.e.. 


p(X 


!1  if  X  Is 
0  otherwii 


Ls  consistent 

otherwise  (4.9) 

To  define  consistency  more  precisely,  we  shall  introduce  additional  index 


sets.  Given  X,  let  1^  and  be  the  sets  of  indices  of  targets  which  are 
hypothesized  by  X  to  be  detected  in  the  current  data  set  and  in  the  cumulative 
data  set,  respectively.  and  are  defined  similarly  for  X.  Such  index¬ 
ing  is  not  unique  since  there  is  no  a  priori  indexing  on  the  targets.  There¬ 
fore,  each  target  index  set  hypothesized  by  X  or  X  should  be  interpreted  as 
one  of  the  equal -probability  representations.  In  addition,  let  1„  =  be 

the  index  set  of  targets  hypothesized  by  X  to  be  newly  detected  at  (k,8).  A 
hypothesis,  X  =  with  the  parent,  X  =  i&  j?nsistent 

with  (a,N^,6,N.p)  if  and  only  if 


1)  Ti  -  Ti  U  {(a(i),k,s)}  for 


2)  T. 


for  i 


^^dcVd’ 


and 


3) 


■  {(a(i),k,8)}  for  idjj* 


(4.10) 


(4.11) 


(4.12) 
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Thus,  if  X  is  consistent  with  «Nj) ,  as  defined  here  is  also  con 

sistent  with  that  given  by  6  in  Section  2. 

Consequently,  (4.4)  is  reduced  to 

p(Z,A|  X,N  ,2,1)  =  TT^  S  P(y|a.N  .<5.X.N.,) 

^  m  (a, 6)  “  T 

p(N^|5.X,N^) 

p(6|X,N^)  (4.13) 

where  the  summation  is  over  the  set  of  (a,6)'s  for  which  X  Is  consistent, 
then  follows  from  (4.3)  and  (4.13)  that 

p(Z,Xlz,X)  =  p(N.j.lZ,X) 

m* 

T 

j  52  f  P(yla,N^6,X,N^)  p(N^l6»X,N^) 

T 

p(6lx,N^)  p(dXlN^,Z,X)  1  .  (4.14) 


Equations  (4.2)  and  (4.14)  allow  the  recursive  computation  of 
p(XlZ)  if  p(N^lz,X)  and  p(dxl  N.j.,Z  ,X  )  are  known.  All  the  other  conditional 
probability  distributions  or  densities  needed  are  given  by  the  sensor  model 


It 
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4.2  Computation  of  p(dx|N^,Z,X)  and  p(N^lz,X) 

Up  to  this  point,  we  have  not  used  the  Markov  nature  of  the  target 
model.  The  updating  of  the  target  state  (X.N.^)  is  by  means  of 


p(dxlN.j,.Z,X)  =  C(N.j,) 


p(yla,N^.6,X,N^)  p(N^|6,X.N^) 


p(6lx,N.j,)  p(dxlN^,Z.X) 


(4.15) 


and 


p(N.j,lZ.X) 


C(Nt)  (Np^!)  p(N^|z,X) 

p(Z,XlZ,X)  N  ! 

m 


(4.16) 


where  C(N^)  is  a  normalization  constant  given  by 


C(N  )  =  p(yla,N^,6,X.N^)  p(N^la,X,N^) 

a, 5 


p(6|X.N  )  p(dX|N  ,Z,X). 


(4.17) 


Extrapolation  can  be  accomplished  through 


p(dX|N„,Z,X)  -  7  F„  (dXjx.At)  p(dx|N  ,Z, 

V 


X) 


(4.18) 


where 


"  ‘'k  ■  '"'k* 
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To  the  best  of  our  knowledge,  the  results  presented  in  this  section  for 
the  general  target  and  sensor  models  are  new.  The  evaluation  of  each 
hypothesis  is  carried  out  recursively  using  equations  (4.2)  and  (4.14). 
Equation  (4.14)  also  requires  the  computation  of  certain  posterior 
conditional  probabilities  for  the  number  of  targets  and  the  target 
states.  These  are  give  by  equations  (4.13)  to  (4.18).  We  can  thus 
theoretically  handle  very  complicated  situations,  such  as  targets  moving 
as  a  group.  However,  since  a  nonlinear  filtering  problem  is  involved, 
the  actual  use  of  this  algorithm  is  not  trivial  unless  some  special 
structures  are  exploited.  An  example  of  this  for  i.i.d.  target  models 
is  discussed  in  the  next  section. 
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5.  INDEPENDENT,  IDENTICALLY  DISTRIBUTED  TARGET  MODELS 


As  we  may  anticipate,  the  fairly  general  algorithm  described  in  the  pre¬ 
vious  section  can  be  greatly  simplified  if  we  assume  that  given  N^,  the  number 
of  targets,  each  individual  target  state  is  an  independent  and  identically 
distributed  random  process.  The  simplification  is  possible  because  many  terms 
in  (4.13)-(4.18)  can  be  expressed  as  products  under  these  assumptions.  In 
this  section,  the  important  subclass  of  i.i.d.  target  models  is  discussed  and 
the  result  will  be  used  to  provide  a  unified  view  of  existing  tracking  algo¬ 
rithms  . 

5. 1  Assumptions  on  Models 

The  following  additional  assumptions  are  used  for  this  section: 
Assumption  A1 

The  target  state  space  for  n  is  the  direct  product  set 

x"  of  a  hybrid  state  X  with  a  hybrid  measure  U.  Given  N^  =  n, 
the  target  state  X  =  ®  system  of  time-homogeneous,  independent 

and  identically  distributed  Markov  processes  with  the  common  statistics  given 
by  the  initial  distribution 

Prob  {x^(t^)edx})  *  q^(x)D(dx)  (5.1) 

and  the  transition  probability  density 

Prob  {x^(t+At)  e  dx  |x^(t)}  »  F(xj^(t+At)  1  x^(t )  ,At)y  (dx) .  (5.2) 
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Assumption  A2 

The  a  priori  distribution  of  N,^,  the  number  of  targets,  is  Poisson  with 

mean  v  . 
o 

Assumption  A3 

NpAi  the  number  of  false  alarms  for  each  data  set  (k,s),  is  independent 
of  any  target  state  or  any  other  data  set  and  has  a  Poisson  distribution  with 
mean  Vj,^  which  may  be  a  function  of  (k,s)  (time  and  sensor).  Given  the 

number  of  false  alarms  at  a  data  set  (k,s),  the  false  alarms  are  i.i.d.  with 
the  common  probability  density  P-»(y)  on  ^  and  are  independent  of  any  target 
state  or  any  other  data  set. 


Assumption  A4 

The  measurement  error  in  y  which  originates  from  a  target  i  in 
any  data  set  depends  only  on  the  target  state  x^.  Thus,  there  exists 
a  measurement  probability  transition  function,  ^ 

such  that 


•y^  ) 


|a,N^,6.X,N^) 


n 

iel_ 


PM^^a(i) 


x^))( 


n 


(5.3) 


jeJ, 


FA 


Assumption  A5 

The  event  pertaining  to  the  detection  of  a  target  i  depends  only  on  its 
state  x^,  namely,  there  is  a  detection  function  6  and  detection  probability 
pjj(.):  X  -►  [0,1]  such  that 


p(6|x,N,j.)  «  II  -Pj,(x^)) 


,l-6(i) 


i-l 


5.2  Hypothesis  Evaluation  Algorithm 


(5.4) 


Assumptions  Al,  A4  and  A5  imply  that,  for  any  (Z,A)  at  any  data  set 
(k.s),  we  have 
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P 


p(dx,,...dx„  |N-,Z,X)  ■  ll  p(»-l2,T-)u(dx.)  PJ  q(x.)p(dxj  (5.5) 

“i  iei„c  *»'dc  ' 

where  A  =  {t.}.  ^  p(.1z,t  )  is  the  probability  density  of  x.(t.)  condi- 

1  lEi-jjc  1-  1  * 

tioned  by  the  corresponding  track  and  the  measurement-value  data  given  by  Z, 
and  q  is  the  common  probability  density  of  a  target  conditioned  by  the  fact 
that  it  has  never  been  detected  up  to  and  including  the  data  set  (k,s). 

On  the  other  hand,  Assumptions  A3  to  A3  together  with  (5.5)  can  reduce 
(4.14)  into  the  following  form: 

-VpA  jq 

P(Z,X|2.T)  ■  Vt-  £  X)  "fa"  n  '’FA'>'j> 

”  Np  (a. 6)  jtJpA 

(.a  p(x^jz,T^)  y(dx^  >)  (.a  q(x^)  y(dx^)^ 

DC  ^  DC 

-  5  p(Ni|5,I)  E  H 

tn  cC  (a,o)  jc^TTA 


D  DC 

f  n  f  (l-Pj-(x))  p(xlz,T  )  V(dx)) 
(l  -  /  Pu(x)  q(x)  U(dx))’^’’ 


(5.6) 
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where  ■  #(1^^)  ■  #(X)  is  the  numher  of  detected  targets  being  hypothesized 
by  A, 

It  is  clear  that  p(N^lz,^)  -  0  if  <  Np^,.  When  a  triple 
^XtNj^.Nx)  is  given,  the  number  of  6'e  such  that  there  exists  an  a 

so  that  X  is  consistent  with  is 


/**T  "  ^’dc\  _  ~  ^DC^* _ 

V  "n  >/=  = 


(5.7) 


where  “  #(Idc>  ’  *  Nj,  -  #(I^)  =  -  N^^,.  For  such  a  6.  there 

are  Nj^j  permutations,  or  Nj^!  a'a  for  which  X  is  consistent  with 
Therefore,  the  number  of  (oi,  d)  s  with  which  X  is  consistent  is  given  by 

_  Njjq)! 


Furthermore,  for  a  given  (>^.N^,Nx).  all  (0(,6)'s  with  which  X  is  consistent 
should  agree  on  1^^,  i.e.,  if  X  is  consistent  with  (a, 6)  and  (a ',6')  we 
must  have  a(l)  -  a'(i)  and  6(i)  -  6'(i)  for  all  In  addition,  for  all 

(cx,6)'s  with  which  X  is  consistent,  the  product 


PM^ya(i)'*^  q(x)y(dx) 


(5.9) 


has  the  same  value  as  a  product  even  though  individual  multipliers  and 
Ijj  may  vary.  Thus,  the  four  products  behind  the  summation  ^(0^5) 
in  the  last  expression  of  (5.6)  have  the  same  value  for  all  such  (C(>5)'s. 


26 


Consequently,  when  we  choose  one  (a, 6)  with  which  X  is  consistent  and 


define  ■  {ot(i)  ]  i^Ijj},  (5.6)  is  further  reduced  to 
p(Z,Xlz J) 


m 


P(x|Z,T^)  p(dx) 

V  ^DC 

n  f  P(x|Z,T,)  p(dx) 


Pi  Pj^(yj|x)  Pp(x)  q(x)  p(dx) 


-X 


V  ^V^Dc>'  r  N. 

ZmJ  P(N  lz,X)  .  — yr  (1  -  /p^(x)  q(x)  u(dx))\ 


T  DC 


Using  a  similar  argument,  equation  (4.16)  can  be  reduced  to 


(5.10) 


P(N JZ.X) 


S  (N^-Np^) :  ~  IJ(dx))  P(N^|Z,X) 


if  N  >  N 
T  -  DC 


0  otherwise 


(5.11) 


where  C^j  is  a  normalizing  constant.  Then,  using  an  inductive  argument,  it  is 
easy  to  show  that  at  any  data  set  (k,B),  p(Nj|z,X)  is  a  biased  Poisson  dis¬ 
tribution.  In  particular,  we  have 


-  V  V^^T”%C^  — 

e  - : -  if  Nt  ^  ‘^DC 


p(N^lZ.X)  - 


(Nt-Ndc): 


otherwise 


(5.12) 


DC 
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where  V  is  the  expected  number  of  undetected  targets  up  to  and  including 
(k',s').  V  is  common  to  every  X  end  is  given  by  recursion. 

By  substituting  (5.11)  into  (5.10)  and  using  the  basic  equation  (4.2) 
obtain  the  following  recursive  equation: 


)(Xlz) 


P(XIZ) 


exp(v^^  4  (1-  L„„)V)  p(zlz) 


FA 


oo 


n  n_  i^iau) 


0  ..  n 


lo  Tf o  j 


(5.13) 


where 


^FAj  “  ^FA^FA^yj^ 

is  the  likelihood  of  the  jth  measurement  being  a  false  alarm, 

^ij  •/  Pd^*^  p(xjZ.T.)  y(dx) 

A 

is  the  likelihood  of  the  jth  measurement  originating  from  the  ith 
detected  target, 


(5.14) 


(5.15) 


-  r  (I-Pp(x))  p(x|Z,T^)  v(dx) 


(5.16) 


,  we 
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is  the  likelihood  of  the  ith  previously  detected  target  missing  in  the  current 
data  set, 

Lpj  “  Vi(dx)  (5.17) 

)( 

is  the  likelihood  of  the  jth  measurement  originating  from  a  newly  detected 
target,  and 


L 

oo 


1 


(x)  q(x) 


y{dx) 


(5.18) 


is  the  likelihood  of  an  undetected  target  remaining  undetected  in  the  data 
set . 


The  updating  and  extrapolation  equations  given  by  (4.15),  (4.16)  and 
(4.18)  can  now  be  simplified.  Updating  is  given  by  the  following  equations. 
For 

p(x|z,T.)  =  PM^ya(i)'*^  p(x1z,‘t.).  (5.19) 

For  ic 

p(x|Z,T.)  =  L.q"^  (1  -  Pi,(x))  p(x|Z,?’^).  (5.20) 


For  i  eijj. 


p(x|z,T.)  -  L^,oi(i)~^  PM^ya(i)l*^ 


(5.21) 


V,  the  new  expected  number  of  undetected  targets, is  given  by 


V  ■  V  L 


oo 


(5.22) 


where  v  becomes  v  at  the  next  data  set.  q(.)  should  be  replaced  by 


-1 


q(x). 


(5.23) 
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When  At  ®  ^  0,  extrapolation  is  accomplished  by  using  the 

following  equations  where  after  extrapolation  p(.l  Z,T^)  and  q(.)  are 
replaced  by 

F(x|x,At)  p(xlz,T^)  y(dx)  (5.24) 

and 

,^F(x|x,At)  q(x)  y(dx)  (5.25) 

respectively . 

Equations  (5.13)  -  (5.25)  provide  the  basic  algorithms  for  the  tracking 
of  multiple  independent  and  identically  distributed  targets.  Equation  (5.13) 
is  the  key  equation  and  computes  the  probability  of  a  hypothesis  recursively 
using  some  basic  likelihood  functions.  These  likelihood  functions  are  given 
by  equations  (5.14)  to  (5.18).  All  the  necessary  conditional  probabilities  on 
the  target  states  are  given  by  equations  (5.19)  to  (5.25).  All  the  likelihood 
functions  have  very  intuitive  explanations  and  are  based  on  the  target  and 
sensor  models.  In  the  next  section,  we  relate  this  algorithm  to  other  exist¬ 
ing  results. 
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6.  RELATION  TO  OTHER  RESULTS 


The  results  in  Section  4  for  general  target  models  are  new  to  the  best 
of  our  knowledge.  Even  when  specialized  to  i.i.d.  target  models,  the  algo¬ 
rithm  given  by  equations  (5.13)-(3.25)  has  been  derived  using  more  general 
models  than  usually  assumed  in  the  literature.  In  particular,  hybrid  (con¬ 
tinuous  and  discrete)  target  models  and  complex  p^  models  can  be  handled 
theoretically,  although  the  actual  implementation  may  be  nontrivial.  In  this 
section  we  compare  our  results  on  i.i.d.  target  models  to  some  existing  algo¬ 
rithms.  It  will  be  shown  that  these  algorithms  can  be  obtained  from  our  basic 
algorithm  when  certain  approximations  are  made. 


Since  equation  (5.13)  is  recursive  in  nature,  repeated  application  of 
(5.13)  leads  to  the  following  batch  form. 


p(Xlz)  -  C(Z)-1  L  [\ 

ici 


DC 


(6.1) 


where  C(Z)  is  a  normalization  constant  given  by 


C(Z)  =  p(Z)  exp 


(k^6')  ^  (k,s) 


n  n 


“FA  ^FAj, 


(k' , s' )  ^  (k,s)  jej 


FA 


(6.3) 


and  can  be  computed  recursively  using  equations  (5.13)-(5.17) . 


The  batch  form  (6.1)  is  similar  to  the  basic  criterion  function 
used  in  Morefield's  algorithm [16 ]  where  0-1  linear  programming  is  used  for  the 
final  optimization.  It  should  be  noted  that  in  our  derivation  of  (6.1),  we  do 
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not  have  to  evaluate  p(X),  the  a  priori  probability  of  a  hypothesis  in 
Morefield's  formulation. 


Almost  all  the  known  algorithms  in  multitarget  tracking  are  based  on 
assumptions  introduced  in  Section  5,  although  in  some  cases  these  assumptions 
have  not  been  stated  explicitly.  In  addition,  the  following  assumptions  are 
usually  made  when  classification  is  not  of  interest. 


(1)  Pj^(yj|x)  is  defined  by  a  linear  Gaussian  model,  i.e. 


yj  =  Hx  +  V  (6. A) 

where  U  is  a  matrix  and  v  is  a  Gaussian  noise  process. 

(2)  is  a  uniform  density. 


In  many  cases,  it  is  also  reasonable  to  assume  that  q(.),  the  distribu¬ 
tion  of  an  undetected  target,  has  a  much  bigger  variance  than  that  of  Pj^(,|x). 
this  case,  p(.|Z,T)  is  approximately  Gaussian,  and  hence  equations  (5.19)  and 
(3.24)  reduce  to  the  standard  Kalman  filter  equations.  The  uniformity  assump¬ 
tion  of  Pj,^  reduces  to  a  constant  which  is  actually  the  number  of  false 

alarms  per  unit  scan  volumn.  Furthermore,  if  we  assume  that  Pq(.)  is  constant 
over  the  sensor's  field  of  view  which  is  large  compared  with  the  variance  of 
any  reasonable  p(.|z,T),  then  (5.13)  and  (5.16)  can  be  approximated  by 

^ij  “  Pd  p(x|z,T^)  u(dx)  (6.5) 

and 

Lio  -  1  -  pjj  (6.6) 
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where  is  the  constant  value  of  p^C.).  It  is  now  clear  that  the  algorithm 

given  by  (5.13)  to  (5.25)  coincides  with  Reid's  algorithm  [20]  except  for  j . 
the  new  target  likelihood  function,  i^ich  in  our  case  is  computed  from  V  and 
q(.).  The  corresponding  term  in  [20)  is  called  the  new  target  density  and  is 
said  to  "depend  on  the  number  of  times  the  area  has  been  observed  by  a  type  1 
sensor  and  the  possible  flux  of  undetected  targets  into  and  out  of  the  area." 
However,  no  expression  is  given  for  its  computation  in  [20].  Although  the 
computation  of  as  given  by  (5.17)  is  not  easy,  it  is  an  important  term  in 
evaluating  hypotheses  and  initiating  new  tracks,  particularly  when  a  number  of 
returns  are  obtained  in  just  a  few  scans. 

As  in  [20],  there  is  no  separate  track  initiation  pr'tcess  in  our  algo¬ 
rithm.  This  can  be  considered  to  be  more  general  than  algorithms  such  as 
those  in  [13], [21]  where  a  separate  initiation  process  is  required,  in  the 
following  sense.  If  the  cumulative  measurement  index  set  of  (3.2)  is  expanded 

to  include  {1 . N)  x  {(0,0)}  where  N  is  the  number  of  a  priori  tracks,  then 

the  general  equation  (5.13)  reduces  to  an  algorithm  with  a  separate  track  ini¬ 
tiation  process  where  the  recursion  (5.13)  is  started  with  a  single  probabil¬ 
ity  one  hypothesis  containing  the  W tracks. 

It  is  well  known  that  the  number  of  hypotheses  grows  very  rapidly  in  an 
algorithm  of  this  type.  Therefore,  for  a  multi-hypothesis  type  tracking  algo¬ 
rithm  to  be  implementable,  some  form  of  hypothesis  management  scheme  must  be 
used.  Many  hypotheses  management  schemes  [20]  are  available,  e.g.,  fixed 
level,  fixed  breadth  or  adaptive  pruning,  M-scan  or  similar  hypothesis  combin¬ 
ing,  windowing  (dati.  validation),  clustering,  etc.  In  some  existing  algo¬ 
rithms,  one  of  the  above  strategies  is  used  to  its  extreme.  For  example,  a 
zero  scan  algorithm  as  defined  in  l20]  is  used  to  obtain  the  probabilistic 
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data  association  (PDA)  filter  in  [10]  and  the  joint  probabilistic  data  associ¬ 
ation  (JPDA)  filter  in  l21].  Extensive  combining  is  used  in  the  Gaussian  sum 
approach  of  Alspach  [13].  These  will  be  discussed  in  detail  in  Section  7. 
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7.  HYPOTHESIS  MANAGEMENT  TECHNIQUES 


It  should  be  obvious  that  any  algorithm  which  forms  multiple  hypotheses 
from  the  data  suffers  from  the  rapid  growth  in  the  number  of  hypotheses.  The 
growth  is  actually  worse  than  exponential  although  no  worse  than  factorial. 
Thus  adequate  hypothesis  management  to  control  the  number  of  hypotheses  is 
essential  for  any  successful  implementation  of  such  algorithms.  Many 
hypothesis  management  techniques  have  been  proposed  in  the  past.  For  the  sub¬ 
class  of  multitarget  tracking  problems  described  in  Section  3,  almost  all  the 
existing  techniques  are  needed.  These  techniques  have  usually  been  proposed 
based  on  intuitive  reasons  rather  than  mathematically  rigorous  arguments.  An 
exception  is  a  recent  report  [27]  in  which  "optimal"  pruning  and  windowing  is 
discussed.  It  is  the  authors'  opinion,  however,  that  these  results  may  only 
be  applicable  to  special  cases. 

Thus  no  general  theory  on  hypothesis  management  techniques  exists  at  the 
present  moment.  The  purpose  of  this  section  is  to  summarize  some  existing 
techniques  and  describe  any  modifications  to  such  techniques  adopted  by  the 
authors.  He  divide  the  hypothesis  managements  techniques  into  the  following 
four  classes: 

1.  Pruning  ....  cutting  branches 

2.  Combining  ....  binding  branches  together 

3.  Windowing  ....  data  validation 

4.  Clustering  ....  data  partition 

In  the  following,  we  shall  discuss  the  techniques  according  to  the  above 
classification.  Although  some  of  the  techniques  described  below  may  apply  to 
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the  general  model  of  Section  4,  for  the  most  part  we  shall  restrict  our  atten¬ 
tion  to  the  i.i.d.  target  case  where  all  the  assumptions  in  Section  5  are 
satisfied. 

7.1  Pruning 

Pruning  techniques  can  be  further  classified  into  (1)  thresholding,  (2) 
breadth  control,  and  (3)  adaptive  pruning  techniques. 

The  basic  philosophy  behind  thresholding  is  to  cut  (or  remove)  the 
"insignificant"  hypotheses  which  in  turn  tend  to  produce  more  insignificant 
hypotheses.  In  [20],  it  is  proposed  to  cut  any  hypothesis  with  posterior  pro¬ 
bability  less  than  a  fixed  predetermined  threshold.  In  the  i.i.d.  target 
case,  the  thresholding  may  be  performed  at  the  track  level  using  the  track 
likelihood  functions  described  in  Section  5.  One  of  the  disadvantages  of  this 
fixed  thresholding  is  that  it  is  performed  without  any  consideration  of  the 
available  computational  resources  or  the  external  condition  (e.g.,  clear 
versus  confusing,  etc.).  For  example,  given  the  same  computational  resources, 
one  should  be  able  to  keep  more  hypotheses  for  little  available  data  than  for 
a  large  amount  of  data.  This,  however,  is  not  present  in  the  fixed  threshold¬ 
ing  scheme. 

This  consideration  leads  to  the  second  subclass  of  breadth  control  tech¬ 
niques  in  which  a  fixed  number,  say  H,  of  the  best  hypotheses  are  chosen  and 
propagated  forward.  This  is  proposed  by  Keverian  in  [17].  Choosing  a  fixed 
breadth  M  makes  sense  when  we  regard  the  number  of  hypotheses  kept  as  a  meas¬ 
ure  of  the  computational  and  memory  requirements.  However,  fixed  breadth  con¬ 
trol  may  lose  its  rationale  quickly  when  some  form  of  clustering  is  used  since 
the  resources  cannot  be  efficiently  allocated  among  the  clusters.  Also,  the 


breadth  control  or  Mxed  breadth  method  requires  a  sorting  algorithm  which 
requires  additional  effort  although  this  Issue  may  not  be  Important  since  many 
good  sorting  algorithms  do  exist.  When  breadth  control  Is  used  extensively  to 
Its  limit,  only  one  (best)  hypothesis  Is  selected  and  propagated  forward.  In 
[20],  this  mode  of  pruning  Is  called  a  zero-scan  algorithm. 


Although  fixed-threshold  pruning  may  be  viewed  as  adaptive-breadth 
pruning,  and  vice  versa,  these  techniques  do  not  really  adapt  to  the  complexity 
of  the  situation.  The  third  subclass  of  pruning  techniques,  called  adaptive 
pruning,  is  proposed  by  the  authors  to  be  more  adaptive.  In  this  strategy, 
the  hypotheses  are  first  sorted  into  the  descending  order  of  their  posterior 
probabilities.  Then,  when  the  cumulative  sum  of  the  probabilities  from  the 
best  hypothesis  exceeds  a  given  threshold,  the  remaining  low  probability 
hypotheses  are  pruned.  This  method  may  be  called  adaptive-threshold /adaptive- 
breadth  pruning  since  It  adjusts  both  the  absolute  threshold  and  the  breadth 
according  to  the  complexity  of  the  external  condition,  i.e.,  the  more  complex 
the  situation  is  the  more  low  probability  hypotheses  are  retained.  The 
adaptive  pruning  techniques  make  more  sense  than  other  pruning  methods 
when  clustering  is  used  and  may  be  viewed  as  a  way  of  automatically  allocating 
computational  and  memory  resources  among  the  clusters.  However,  it  still 
suffers  from  the  same  drawback  of  any  fixed  thresholding  scheme  in  that  the 
actual  (absolute)  computational  and  memory  resources  cannot  be  predicted. 
Furthermore,  some  form  of  sorting  is  still  needed. 

From  a  theoretical  point  of  view,  the  posterior  probabilities  of 
hypotheses  may  be  considered  as  a  discrete  distribution.  Hypothesis  pruning 
may  then  be  viewed  as  picking  the  approximation  techniques  for  the  distribu¬ 
tion.  Figure  7-1  displays  the  approximation  involved  in  the  three  schemes. 
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Pruning  Strategies 


Thus  the  theoretical  issues  in  hypothesis  pruning  are  what  a  good  approxima¬ 
tion  should  be  and  how  it  influences  the  future  evaluation  in  multitarget 
tracking.  Although  some  theories  on  the  approximation  of  probability  distri¬ 
butions  (e.g.,  Sorenson  and  Alspach  [28])  may  give  us  some  insight,  we  believe 
that  hypothesis  pruning  is  still  an  open  research  area. 

7.2  Comb in ing 

The  existing  combining  techniques  can  be  divided  into  two  subclasses: 

(1)  distribution-oriented  techniques  and  (2)  measurement-index-oriented 
techniques . 

The  philosophy  behind  the  first  subclass  is  to  combine  two  similar 
hypotheses .  where  similarity  is  interpreted  in  a  certain  way,  depending  on  the 
state  distribution.  According  to  Reid  [20],  two  hypotheses  are  similar  if 
they  have  the  same  number  of  tracks  and  each  track  in  one  hypothesis  has  a 
unique  companion  track  which  is  similar  to  it  in  the  other  hypothesis.  The 
similarity  of  tracks  is  measured  by  the  state  estimate  distributions,  which 
accounts  for  the  name  of  distribution-oriented  techn ioues .  The  rationale 
behind  this  approach  is  that  each  track  state  distribution  should  reflect  all 
the  relevant  information  which  affects  any  future  event  due  to  the  underlying 
Markovian  assumptions.  Thus,  if  two  state  distributions  of  tracks  are  close 
enough,  we  «K>uld  expect  the  future  behavior  of  the  two  tracks  to  be  similar. 

Suppose  two  hypotheses  and  ^2  similar,  where 

Xi  ■  {Tj . ,T^}  i  ■  1,2.  Then  hypothesis  combining  leads  to  a  new 

hypothesis  X  «  {Tj . t^}  with 

p(X|Z)  -  p(Xjlz)  +  p(X2lZ)  (7.1) 
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and  for  j  *  1 , . . .  ,n 


p(xlT^,Z)  =  p(X^  IZ)p(xIZ.tV)  +  pa2lZ)p(x|Z,Tj^^j)  (7.2) 

where  x(.)  is  a  permutation  which  maps  a  track  into  a  similar  track. 

However,  there  still  remains  the  crucial  question  of  choosing  a  good 
measure  of  "similarity"  and  a  good  threshold  for  that  measure.  When  each 
track  distribution  is  Gaussian,  Reid  [20]  proposes  inequality  tests  using 
the  means  and  the  diagonal  elements  of  the  covariance  matrices. 

However,  no  theoretical  justification  for  the  use  of  those  particular 
inequalities  is  given.  His  intuitive  reason  is  that  for  tracks  to  be 
similar,  both  their  means  and  their  variances  should  not  be  widely 
different.  This  test  may  work  well  for  Gaussian  distributions,  but  may 
prove  to  be  inadequate  for  more  general  distributions. 

Distribution-oriented  combining  is  used  to  its  extreme  in  [11]  and  [21] 
where  all  the  hypotheses  are  combined  after  proper  windowing  (described 
below)  and  a  fixed  number  of  targets  are  assumed  i.e.,  every  hypothesis 
has  the  same  number  of  tracks.  When  two  Gaussian  distributions  are 
combined,  the  combined  distribution  becomes  a  Gaussian  sum  distribution 
because  two  different  hypotheses  represent  two  disjoint  events.  When  a 
Gaussian  sqm  distribution  is  approximated  by  a  Gaussian  distribution, 
the. means  and  the  variances  are  usually  equated.  Unlike  the  results  in 
[20]  or  [11],  the  Gaussian  sum  form  is  preserved  to  a  certain  extent  in 
[13]  where  each  track  distribution  remains  a  Gaussian  sum  rather  than 
Gaussian.  In  this  case,  the  hypothesis  trees  are  extended  to  include 
one  lower  level,  namely,  the  distribution  level.  The  hypothesis 
management  (pruning  and  combining)  techniques  must  then  be  extended  to 
include  this  level. 

AO 


In  sununary,  unless  each  track  distribution  is  assumed  to  be  and  forced 
to  be  Gaussian,  the  similarity  criteria  proposed  in  [20],  [11],  etc., 
may  sometimes  be  unjustified.  Theoretical  results  on  similarity 
criteria  are  still  lacking  in  our  opinion. 

On  the  other  hand,  the  measurement-index-oriented  combining 
techniques  consider  each  track  as  a  subset  of  the  past  cumulative 
measurement  index  set  as  defined  in  Section  3.  This  technique  has 
been  proposed  by  Singer,  et.  al . ,  [9]  and  is  a  classical  technique  in 
the  multitarget  tracking  literature.  In  these  schemes,  the  tracks  whose 
measurement  indices  on  the  past  N  scans  are  the  same  are  regarded  as 
"similar"  and  identified.  Thus  they  are  often  referred  to  as  N-scan  or 
depth-N  methods.  In  Figure  7-2,  hypotheses  1  and  2  can  be  combined  if  N  =3. 

The  justification  is  that  since  each  track  distribution  is  driven  by 
the  measurements  assigned  to  it,  if  two  tracks  share  the  same 
measurements  in  the  recent  scans  (data  sets)  they  should  be  similar. 

This  scheme  is  criticized  by  Reid  [20]  on  the  ground  that  some  events  in 
the  past  may  have  a  greater  influence  than  the  most  recent  N  scans. 

However,  since  the  dynamical  nature  of  a  target  model  removes  this 
possibility,  the  N-scan  approach  is  attractive  because  of  its  simplicity. 

After  identifying  tracks  according  to  the  N-scan  or  depth-N  criterion, 
we  may  have  several  identical  hypotheses,  i.e.,  hypotheses  with  the 
identical  set  of  tracks.  Then  those  hypotheses  are  combined  in  a 
natural  way.  In  a  sense,  this  approach  may  be  actually  viewed  as 
combining  tracks  rather  than  combining  hypotheses.  In  fact,  since 
similarity  is  initially  defined  at  the  track  level  even  in 
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distribution-oriented  methods,  one  may  further  classify  the  combining 
techniques  according  to  when  combining  takes  place.  For  example, 
distribution-oriented  combining  may  be  performed  at  the  track  level  or 
at  the  hypothesis  level.  Vhile  track-level  combining  may  seem  to  be 
more  straightforward,  it  creates  another  problem,  namely,  how  two 
distributions  should  be  combined,  since  there  is  no  natural  weighting 
formula  similar  to  that  like  (7.2)  used  in  distribution-oriented 
combining  at  the  hypothesis  level. 

To  summarize,  N-scan  or  depth-N  methods  have  two  major  disadvantages, 
namely,  the  unresolved  issues  of  (1)  how  to  choose  a  right  depth  N,  and  (2)  how 
to  combine  track  state  distributions.  Just  as  in  the  case  of  pruning,  many 
theoretical  questions  remain  in  combining  hypotheses.  Our  current  preference 
is  distribution-oriented  combining  at  the  hypothesis  level  since  there 
is  a  clear  way  for  combining  two  probability  distributions.  The 
similarity  condition,  however,  should  be  carefully  chosen  according  to 
the  physical  nature  of  the  particular  problems  and  the  chosen 
representation  of  each  track  distribution,  etc. 

7.3  W indowing 

When  an  i.i.d.  target  model  is  used  with  other  assumptions  described  in 
Section  3,  each  measurement  data  can  be  individually  evaluated  by 
likelihood  functions  given  by  (5.14),  (5.15)  and  (5.17).  When  a  track 
state  distribution  has  a  reasonable  variance  and  the  measurement  errors 
are  not  exceptionally  large,  one  can  expect  the  track -measurement 
likelihood  given  by  (5.15)  to  be  very  small  for  measurement  data  which 
are  geometrically  far  from  the  expected  position  based  on  the  state 
distribution  associated  with  the  track.  Windowing  techniques  are 


generally  designed  to  set  an  appropriate  threshold  so  that  the 
track-measurement  likelihood  in  such  a  case  becomes  zero  rather  than  a 


small  positive  number. 

Thus,  one  may  consider  such  techniques  to  be  a  special  kind  of  pruning, 
i.e.,  immediate  pruning  of  branches  based  solely  on  one  likelihood  function. 
In  other  words,  windowing  is  a  method  for  eliminating  a  certain  set  of  data 
to  be  associated  with  each  track.  For  this  reason,  such  a  process  is  often 
called  data  validation.  When  track  state  distributions  and  measurement  error 
distributions  are  both  Gaussian,  windowing  can  be  accomplished  by  a  classical 
chi-square  test.  As  described  in  [16],  this  test  may  be  performed  in  several 
steps.  For  example,  the  first  step  may  consist  of  a  8,^  test  (square  test)  , 
and  then  a  normalized  square-of-innovation  test  (ellipse  test),  and  finally, 
the  likelihood  function  test  itself. 

Another  view  of  windowing  is  that  it  is  a  part  of  the  distribution 
representation  and  modeling  process.  According  to  this  view,  when  the  track 
state  and  measurement  distributions  are  modeled  as  Gaussian,  they  really 
should  be  viewed  as  approximations  of  reality  since  such  distributions 
can  only  have  compact  supports  in  the  real  world.  For  example,  when  the 
standard  deviation  of  the  measurement  error  is  one  mile,  a  data  point  100 
miles  away  from  the  mean  of  the  track  distribution  should  yield  zero  as 
its  likelihood  rather  than  a  very  small  but  positive  number.  The  authors 
prefer  this  point  of  view  to  the  pruning  or  approximation  view.  Thus  any 
windowing  process  should  be  carefully  designed  so  that  the  particular 
physical  nature  of  the  problem  may  be  adequately  reflected. 
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7.4  Cluster In, 


The  basic  idea  behind  clustering  is  that  two  events  taking  place  at 
locations  far  apart  should  be  independent  and  can  be  evaluated  separately. 
Clustering  techniques  have  been  described  in  an  algorithmic  fprm  in  [20] 
for  general  cases  and  more  rigorously  in  [11]  for  a  special  case.  When 
adequate  windowing  is  performed t  there  is  a  natural  way  to  avoid  redundant 
calculations  in.evaluating  hypotheses  since  the  posterior  probability  of 
each  hypothesis  is  the  product  of  an  appropriate  set  of  likelihood  functions 
as  shown  in  Section  6.  This  constitutes  another  view  of  clustering. 

Mathematically,  clustering  can  be  defined  as  follows. 

Let  A  be  the  set  of  all  non-zero-probability  hypotheses  at  a  given  data 
set,  i.e. ,  for  all  X  c  A, 

p(AlZ)  >  0.  (7.3) 

For  each  possible  track  T,  the  posterior  probability  of  T  is  given  by 

p(T|Z)  =  s  p(XlZ).  (7.4) 

T  e  A  c  A 

Let  T  be  the  set  of  all  non-zero-probability  tracks,  i.e.,  for  all  ^  T, 

p(T|Z)  >  0  (7.5) 


Let  C  be  any  partition  of  T  which  satisfies  the  following  condition: 
For  any  pair  (C  ,C")  of  elements  in  C,  such  that 
C'  +  C",  and  any  t'  e C'  and  x"  e  C”, 
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Thi^  condition  means  that  the 'non-zero-probability  tracks  are 
parb^itiOtaed  so  that  no  two  tracks  which  are  in  different  elements 

((liiisce4,s^  j)!*  the  partition  share  a  common  measurement  index.  For  each 

t  ■«  I 

0  in  (?,  let 


and  ' 


Ag  =  {Xnc|XcA} 


Ic  =  UC. 


(7.7) 

(7.8) 


Then  clustering  is  the  process  of  generating  ((1^,,  A^,),  CeC).  Each  A^ 
is  the  set  of  local  hypotheses  which  consists  only  of  tracks  in  C.  For  each 
local  hypothesis  X^=xnc,  the  local  posterior  probability  is  given  by 


Pc(XclZ)  =  2{p(XlZ)|XeA,  xnc  =  X(,}, 


(7.9) 


Then  it  is  clear  from  (6.1)  that 


P(A)Z) 


(7.10) 


Each  global  non-zero-probability  hypothesis  can  thus  be  represented  as  a 
union  of  local  hypotheses  (one  from  each  cluster)  and  its  posterior  probabil¬ 
ity  is  the  product  of  the  local  probabilities  of  the  local  hypotheses.  From 
this  definition,  we  see  that  clustering  involves  partitions  at  all  levels, 
i.e.,  hypothesis,  track  and  measurement  levels. 


Equation  (7.10)  is  called  the  orthogonality  condition.  According  to  the 
above  definition  of  clustering,  the  orthogonality  condition  should  hold  when¬ 
ever  the  non-intersection  condition  of  the  tracks  given  by  (7.6)  holds.  How¬ 
ever,  when  some  approximation  techniques  such  as  pruning  and  combining  are 
employed,  this  may  not  be  true  any  more.  The  clustering  technique  described 
in  [20]  is  a  method  in  which  the  orthogonality  condition  is  maintained  without 
checking  the  non-intersection  condition  of  the  tracks. 
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This  technique  can  be  described  in  terms  of  algorithmic  procedures  as 


follows : 


1.  Initialization  of  a  Cluster 


Whenever  there  is  a  measurement  such  that  the  newly  detected  target 
likelihood  is  not  zero  but  the  track-measurement  likelihood 
with  every  existing  track  is  zero,  a  new  cluster  should  be  created 
out  of  the  measurement. 


2.  Cluster  Merging 

Whenever  there  is  a  measurement  such  that  each  of  the  corresponding 
track-measurement  likelihood  functions  with  two  or  more  tracks  in 
different  clusters  is  non-zero  (in  other  words,  there  is  a  measure¬ 
ment  lying  in  the  intersection  of  the  validation  regions  of  two 
tracks  in  two  different  clusters),  such  clusters  should  be  merged 
before  the  measurement  can  be  processed.  The  merging  of  the  clusters 
is  accomplished  by  forming  the  union  of  the  tracks  in  the  clusters, 
generating  the  global  hypotheses  and  evaluating  the  global  probabili¬ 
ties  as  the  products  of  the  local  probabilities. 

3.  Cluster  Splitting 

Whenever  a  track  with  probability  one,  i.e.,  one  contained  in  every 
local  hypothesis  in  a  cluster  is  found,  it  is  split  to  form  a  new 
cluster  consisting  of  one  hypothesis  with  the  sole  track.  Of  course, 
the  local  probability  of  such  hypothesis  is  one. 
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It  is  the  authors'  opinioc  that  any  serious  attempt  on  practical  problems 

should  not  be  made  without  clustering,  particularly  in  a  problem  in  which  a 
large  area  is  covered.  One  may  even  assert  that  clustering  is  probably  the 
most  powerful  hypothesis  management  technique  in  controlling  the  number  of 
hypotheses.  Of  course,  how  successful  a  clustering  technique  is  depends  on 
the  external  conditions  such  as  target  density,  measurement  errors  and  targets 
dynamics . 

The  clustering  procedure  described  above  does  not  necessarily  guarantee 
the  finest  clustering.  The  finest  clustering  may  be  found  according  to  our 
mathematical  definition  of  clustering.  The  test  of  the  non-intersection  con¬ 
dition  can  be  easily  implemented  if  we  identify  two  tracks  with  the  same  meas¬ 
urement  indices  in  a  certain  number  of  the  most  recent  scans  just  like  in  a 
measurement-index-oriented  combining  scheme.  The  orthogonality  condition  can 
be  net  by  modifying  the  local  probabilities  using  appropriate  approximation 
techniques  whenever  possible.  This  constitutes  a  new  cluster-splitting  tech¬ 
nique  which  may  improve  on  that  described  above.  Although  this  newly  proposed 
version  of  clustering  seems  promising,  we  do  not  have  any  actual  implementa¬ 
tion  experience  yet. 
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8.  IMPLEMENTATION 


In  the  previous  sections,  ve  have  presented  a  unified  theory  for  multi- 
target  tracking  and  classification.  In  this  section  ve  describe  the  General¬ 
ized  Tracker/ Classif ier  (GTC)  which  implements  the  algorithms  developed  in  the 
theory.  The  Generalized  Tracker/Classif ier  has  a  structure  given  by 
Figure  1-1.  It  has  three  off-line  modules  and  four  on-line  modules. 

The  three  off-line  modules  are: 

1.  Generalized  Target  Dynamics  Model 

2.  Environmental  Model 

3.  Sensor  Model 

These  represent  the  knowledge  about  the  physical  world  that  needs  to  be  con¬ 
sidered  in  the  design  and  selection  of  the  algorithms.  Mathematically,  they 
are  described  in  Section  2  and  include  almost  all  other  models  as  special 
cases . 

The  four  on-line  modules  are: 

1.  Hypothesis  Formation 

2.  Hypothesis  Evaluation 

3.  Filtering  and  Parameter  Estimation 

4.  Hypothesis  Management 

The  hypothesis  formation  module  generates  the  data-to-data  association 
hypotheses  which  identify  the  data  reported  at  different  times  from  different 
sensors  with  the  same  targets.  It  carries  out  the  function  described 
mathematically  in  Section  3.  This  module  uses  only  the  information  in  the 
measurement  indices  and  does  not  require  the  actual  values  of  the  measure¬ 
ments.  Since  no  model  information  is  needed,  this  module  is  model 
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independent.  Although  the  hypotheses  sre  defined  as  collections  of  tracks 
which  are  in  turn  collections  of  measurement  indices,  an  equivalent  and  more 
convenient  representation  for  implementation  is  by  means  of  a  tree.  In  this 
representation,  each  level  in  the  tree  corresponds  to  a  measurement  index  and 
a  node  corresponds  to  a  target.  Hypothesis  generation  given  a  new  sensor 
report  then  reduces  to  the  expansion  of  the  tree  and  a  branch  of  the  tree 
represents  a  particular  data-to-data  association  hypothesis.  The  concepts  of 
the  parent  of  a  hypothesis,  defined  earlier  in  Section  3,  is  also  obvious  from 
this  representation. 

Figure  8-1  shows  a  hypothesis  tree  for  two  data  sets  each  with  two  meas¬ 
urements  in  each.  The  tracks  associated  with  each  hypothesis  are  also  given. 

1  2 

For  example,  hypothesis  24  associates  y  ^  and  y  ^  with  the  same  target  (track 

1  2 
5),  and  y^^  with  a  different  target  (track  2).  It  thus  hypothesizes  y  j  to  be 

a  false  alarm.  Note  that  from  two  data  sets  with  two  measurements  each,  we 

have  eight  possible  tracks  and  a  total  of  34  possible  hypotheses. 

The  hypothesis  evaluation  module  evaluates  the  probability  of  each 
hypothesis  given  the  information  available.  For  general  target  models,  it 
performs  the  function  given  by  equations  (4.2)  and  (4.14).  If  i.i.d.  target 
models  are  assumed,  evaluation  is  through  equations  (3.13)  to  (3.17).  Equa¬ 
tion  (3.13)  is  quite  independent  of  the  particular  models  and  provides  the 
structure  of  the  evaluation.  Equations  (3.14)  to  (3.17)  evaluate  the  likeli¬ 
hoods  of  various  associations  and  are  model  dependent.  Thus  the  implementa¬ 
tion  of  the  hypothesis  evaluation  module  consists  of  a  (model-independent) 
track -measurement  cross  reference  table  and  the  (model-dependent)  computation 
of  likelihoods.  As  we  have  seen  in  Section  6,  this  module  is  considerably 
more  general  and  realistic  than  is  currently  available  in  the  literature. 


The  filtering  and  parameter  estimation  module  implements  equations  (4.15) 
and  (4.18)  for  general  target  models  and  equations  (5.19)  to  (5.25)  for  i.i.d. 
target  models.  They  provide  the  necessary  density  or  distribution  functions 
for  hypothesis  evaluation.  Conceptually,  they  solve  the  ordinary  estimation 
problem  when  the  origins  of  the  measurements  are  known.  However,  even  for  the 
i.i.d.  case,  approximations  are  often  needed  to  solve  the  general  nonlinear 
estimation  problem.  When  enough  approximations  are  made,  as  discussed  in  Sec¬ 
tion  6,  the  standard  Kalman  filter  often  results.  One  novel  feature  of  the 
GTC  is  that  the  density  of  undetected  targets  as  well  as  the  expected  number 
of  undetected  targets  is  constantly  updated  at  each  scan.  This  allows  for 
better  track  initiation  than  is  currently  available  in  other  algorithms.  As 
is  expected,  this  module  is  heavily  model  dependent. 

The  hypothesis  management  module  implements  the  ideas  discussed  in  Sec¬ 
tion  7,  and  is  crucial  for  the  successful  operation  of  the  GTC.  It  is  model 
independent  in  the  sense  that  the  techr iques  involved  are  applicable  to  a  wide 
class  of  scenarios.  The  user,  however,  can  <:elect  certain  parameters  to  con¬ 
form  with  the  computational  and  memory  requirements  or  to  reflect  his 
knowledge  about  the  complexity  of  the  situation.  These  parameters  are  the 
pruning  thresholds  in  hypothesis  pruning,  the  thresholds  for  testing  similar¬ 
ity  in  hypothesis  combining,  the  size  of  the  window  in  windowing,  and  the  cri¬ 
terion  used  in  cluster  splitting.  As  has  been  discussed  in  Section  7,  a  good 
theory  of  hypothesis  management  is  still  lacking,  and  thus  the  hypothesis 
management  module  usually  requires  a  lot  of  tuning  before  the  entire  GTC  will 
function  properly.  Some  techniques  In  artificial  Intelligence  may  be  useful 
here. 
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9.  AN  EXAMPLE  -  TRACKING  WITH  AN  MTI  RADAR  SYSTEM 


In  this  section  we  present  an  example  to  illustrate  the  main  features  of 
the  Generalized  Tracker/Classifier  (GTC).  Although  the  algorithm  has  been 
successfully  tested  for  more  complicated  scenarios,  a  simpler  case  has  been 
chosen  here  for  ease  of  exposition.  The  results  of  some  Monte  Carlo  simula¬ 
tion  runs  will  be  used  to  highlight  the  effects  of  some  external  and  internal 
parameters  on  the  performance  of  the  tracker. 


A  moving  target  indicator  (MTI)  is  a  radar  which  is  specially  designed  to 
detect  only  moving  objects  while  avoiding  ground  clutter.  For  the  purpose  of 
this  section,  we  assume  a  type  of  MTI  which  provides  a  three-dimensional  meas¬ 
urement  (range,  bearing  and  radial  velocity)  for  each  detected  object.  The 
altitude  difference  between  the  sensor  and  the  targets  is  assumed  to  be  negli¬ 
gible.  The  radial  velocity  RV  of  an  object  at  in  a  fixed  three-dimensional 
cartesian  coordination  system  with  respect  to  a  fixed  sensor  at  x^  in  the  same 
coordinate  system  is  defined  as 


RV 


(9.1) 


where  x^  is  the  velocity  vector  of  the  object  (the  time-derivative  of  Xq)> 
(.1.)  is  the  inner  product  of  two  vectors,  and  ll.ll  is  the  norm  of  a  vector. 
In  general,  an  MTI  detects  objects  with  a  nonzero  probability  only  when  their 
radial  velocities  exceed  a  certain  fixed  threshold,  called  the  minimal  discer¬ 
nible  velocity  (MDV). 
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We  are  concerned  with  the  surveillance  of  terrain  with  a  road  network 


using  an  MTI  radar  which  is  fixed  (e.g.,  on  a  helicopter).  The  radar  is 
assumed  to  be  at  a  relatively  low  altitude,  and  thus  the  positional  informa¬ 
tion  is  actually  two-dimensional.  The  terrain,  especially  the  road  network, 
is  assumed  to  be  known.  The  objective  is  to  track  multiple  targets  moving 
over  the  terrain  using  a  sensor  which  can  provide  both  positional  and  velocity 
information. 

Our  specific  scenario  consists  of  a  single  straight  road  segment  in  the 
field  of  view  of  an  MTI  radar  (Figure  9-1).  The  road  segment  is  assumed  to  be 
the  only  part  of  a  longer  road  which  is  observable  from  the  radar.  A  target 
(an  object  to  be  tracked,  such  as  a  vehicle)  can  be  identified  by  its  position 
on  the  road  as  measured  from  the  point  which  is  closest  to  the  MTI  radar.  We 
shall  use  the  i.i.d.  target  model  and  the  corresponding  tracking  algorithm 
described  in  Section  5,  together  with  all  the  other  assumptions  made  in  that 
section.  A  target  on  the  road  is  assumed  to  move  at  an  almost  constant  velo¬ 
city,  i.e.,  the  velocity  is  assumed  to  be  a  random  variable  plus  a  random  walk 
with  an  intensity  which  is  small  compared  with  the  variance  of  the  constant 
part.  The  scan  interval,  At,  is  assumed  to  be  constant.  Thus,  the  indivi¬ 
dual  target  dynamics  are  modeled  as 


(9.2) 


where  {tj^,  k  ■  0,1,2,...}  is  the  sequence  of  scan  times,  u(t)  is  the  position 
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Figure  9-1  An  MTI  Tracking  Example 


Figure  9-2  Probability  of  Detection  by  MTI  Radar 


of  a  target  on  the  road  at  time  t,  v(t)  its  velocity  and  {wj^,  k  =  0,1,2,...} 
is  a  sequence  of  zero*iiiean  i.i.d.  Gaussian  random  variables.  The  initial 
position  and  velocity  are  unknown  a  priori.  Therefore,  they  are  assumed  to  be 
uniformly  distributed  over  some  reasonable  ranges.  The  probability  of  a  tar¬ 
get  being  detected  is  a  function  of  its  state  x  (position  and  velocity),  i.e., 

if  1 RV 1  >MDV 

and  u  is  not  masked  (9.3) 

otherwise 

Figure  9-2  shows  the  detection  probability  contour  when  the  masks  are 
ignored.  The  masks  on  the  road,  created  by  the  terrain  (e.g.,  hills),  tall 
trees  and  foliage,  etc.,  may  be  known  exactly  or  only  probabilistically.  In 
this  example  we  assume  the  former  case.  The  field  of  view  and  the  masked 
regions  used  for  the  present  example  are  shown  in  Figure  9-3. 

Given  that  a  target  has  been  detected,  the  measurement  (range,  bearing 
and  radial  velocity)  consists  of  the  true  values  plus  independent  additive 
zero-mean  Gaussian  noises.  The  distribution  of  false  alarm  measurements  is 
assumed  to  be  uniform  over  the  measurement  space.  However,  the  measurements 
which  are  unlikely  to  originate  from  the  road  are  dismissed  as  false  alarms 
before  they  are  used  by  the  tracking  algorithm. 

9.2  Likelihood  Functions  and  Filtering 

In  our  opinion,  the  calculation  of  q,  the  probability  density  of  an 
undetected  target,  is  a  crucial  part  of  the  tracking  algorithm.  This  is  actu¬ 
ally  one  part  of  our  algorithm  which  is  clearly  different  from  other  existing 
tracking  algorithms.  In  the  present  example,  the  density  q  of  the  position 
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Figure  9-3  Road  Model 
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and  the  velocity  of  an  undetected  target  is  approximated  by  a  step  function 


q(u,v)  =  23  X(u;l")  X(v;J  )  (9.4) 

where  X(.;A)  is  the  indicator  (characteristic)  function  of  the  set  A.  The 

quantization  intervals.  I  and  J  ,  are  chosen  to  be 
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(9.5) 


where  Xj^^  «  50  km  is  the  left  limit  of  the  field  of  view,  x^^  -  52.1  km  the 

right  limit  and  the  other  values  are  Ax  *  70  m,  HDV  “  2  m/s,  *  10  m/s,  “ 

20  m/s,  and  V-  >  30  m/s.  x  .  and  x”  „  are  shifted  in  each  extrapolation 
operation.  Their  initial  values  are  chosen  so  that  there  is  still  some  inflow 

of  density  at  the  end  of  all  the  scans  and  that  the  position  of  a  vehicle  is 

uniformly  distributed  over  the  field  of  view. 

The  exact  extrapolation  of  the  density  q  using  the  dynamic  equation  (9.2) 
requires  complicated  numerical  integration.  However,  since  we  assume  that 
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each  target  moves  at  an  almost  constant  velocity,  we  can  approximate  the 
extrapolation  by  a  simple  translation  of  q(.,v)  for  each  velocity  v  by  v  times 
At.  In  order  to  maintain  the  step-function  form  of  (9.4),  the  shifted 
results  are  integrated  after  each  extrapolation.  After  each  scan,  the  density 
q  is  updated  by  (l-Pjj(x)).  For  this  purpose  PpC.)  is  approximated  by  a  step 
function  with  the  same  quantization  cells  as  those  for  the  density  q. 

An  example  of  the  calculation  of  the  density  q  is  shown  in  Figure  9-4,  in 
which  ,  m  =  0,...,31}  for  n  =  1  is  shown  after  each  operation,  n  =  1 
means  that  the  target's  velocity  is  between  2  m/s  and  10  m/s.  Thus,  the 
extrapolation  operation,  (2)  ->  (3),  (4)  ->  (5),  (6)  ->  (7),  (8)  ->  (9),  is  a 

right  shift  with  vAt  =  90  m  where  v  =  6  m/s  is  the  average  velocity  and  At  = 
15  s  is  the  scan  interval.  In  Figure  9-4,  this  right  shift  operation  is 
approximated  to  maintain  the  same  quantization  cells. 

The  probability  of  detection,  Pj^,  is  assumed  to  be  .8,  a  relatively  high 
value.  After  the  first  scan,  the  probability  density  drops  drastically  in  the 
unmasked  regions  due  to  the  relatively  high  p^.  The  change  in  value  in  the 
unmasked  region  after  one  scan  reflects  the  effect  of  the  dependence  of  the 
detection  probability  on  the  radial  velocity.  Thus,  after  scan  0,  an 
undetected  target  in  the  velocity  sector  (2  m/s  to  10  m/s)  is  very  likely  to 
be  either  in  the  masked  regions  or  outside  the  field  of  view.  At  scan  1,  as 
shown  in  Figure  9-4  (a),  an  undetected  target  may  appear  on  the  right  side  of 
a  masked  region.  However,  if  it  does  move  out  of  a  masked  region,  it  should 
be  detected  with  probability  .8.  Thus,  the  density  in  the  unmasked  regions 
drops  again  (Figure  9-4  (a)).  As  these  steps  continue,  we  expect  almost  all 
the  targets  which  have  been  hiding  in  the  masked  regions  to  eventually  come 


out  and  be  detected. 
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Figure  9-4(a)  Density  of  Undetected  Targets  (up  to  Scan  2) 


Figure  9-5  (a)  and  (b)  show  the  likelihood  (also  a  probability  in 

this  case)  of  an  undetected  target  remaining  undetected,  and  v,  the  expected 
number  of  undetected  targets  versus  the  number  of  scans.  The  relatively  high 
values  of  reflect  our  assumption  that  the  density  q  spreads  over  a  wide 

region  where  a  target  can  never  he  detected.  The  initial  value  for  v  is  the  a 
priori  expected  total  number  of  targets  and  is  set  to  be  27,  i.e.,  we 
expect  about  three  or  four  targets  to  appear  in  the  field  of  view  within  the 
ten  scans.  Because  of  the  high  p^,  v  drops  rapidly  in  the  first  few  scans. 
Then  it  decreases  more  gradually,  due  to  targets  moving  into  the  unmasked 
regions.  We  should  note  that  V  is  updated  by  V  If  these  variables 

continue  to  be  calculated  for  further  scans,  converges  to  1  and  v  to  a 
positive  constant,  reflecting  the  fact  that  eventually,  all  the  targets, 
detected  or  not,  leave  the  field  of  view  and  will  never  be  detected. 

The  density  q  is  used  to  calculate  the  new  target  (or  more  precisely,  the 
newly  detected  target)  likelihood  function.  Figure  9-5(c)  shows  some  plots 
for  this  likelihood  function.  In  this  figure,  the  likelihood  for  measurement 
(r,  01,  RV)  is  plotted  for 

cos  0^  “ 

and 


RV  “  10  m/s . 

where  D  ■  50  km  is  the  distance  between  the  MTI  and  the  road,  r  is  the  range 
measurement,  a  the  bearing  and  RV  the  radial  velocity.  The  exact  calculation 
of  the  new  target  likelihood  function  also  requires  a  complicated  numerical 
integration.  A  relatively  crude  approximation  is  used,  in  which  a  zero-mean 
one-dimensional  Gaussian  distribution  is  approximated  by  a  step  function. 
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Figure  9-5(c) 


New  Target  Likelihood  (as  a  function  of  range) 


(9.6) 


1 

p(x)  s  Y,  a  X(x;L  ) 
i  =  -1  ^  ^ 

where  L  ^  =  [-20,-0),  =  [-0,0),  Lj  =  [o,20)  with  =  A  p(x)dx  and  the 

•'  i 

standard  deviation  o. 

As  shown  in  Figure  9-5(c),  the  new  target  likelihood  function  has  a  posi¬ 
tive  value  only  in  the  field  of  view  and  in  the  unmasked  regions.  In  each 
unmasked  region,  since  RV  is  positive  (i.e.,  the  target  is  moving  to  the 
right),  the  left  edge  has  a  greater  value.  As  the  scans  continue,  targets 
hidden  in  the  masks  eventually  come  out  and  are  detected,  and  hence  the  only 
likely  position  for  a  new  target  to  appear  is  the  left  edge  of  the  field  of 
view. 


Other  likelihood  functions  are  calculated  using  appropriate  approxima¬ 
tions.  Once  a  track  is  formed  by  a  single  measurement,  its  state  distribution 
is  always  represented  by  a  two*-dimensional  Gaussian  distribution,  i.e.,  the 
mean  and  the  variance.  When  a  track  is  associated  with  a  measurement,  its 
distribution  is  updated  by  the  extended  Kalman  filter  with  the  linear  target 
model  (9.2)  and  the  nonlinear  measurement  model.  When  a  track  is  not  associ¬ 
ated  with  a  measurement,  the  distribution  is  not  updated  although  the 
corresponding  likelihood  function  (missed-target  likelihood)  is  numerically 
calculated  for  evaluating  hypotheses.  This  approximation  is  justified  because 
of  the  relatively  accurate  range  measurement. 

9.3  Hypothesis  Management 

The  adaptive-threshold/adaptive-breadth  pruning  strategy  of  Sec¬ 
tion  7  is  used.  In  this  pruning  method,  hypotheses  are  sorted  according  to 
their  posterior  probabilities  and  the  low  probability  hypotheses  are  removed 
from  the  tail  so  that  the  number  of  remaining  hypotheses  is  minimum  while  the 
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sum  of  their  probabilities  is  greater  than  a  specified  threshold,  i.e., 


(9.7) 

To  avoid  any  confusion  with  the  terminology  commonly  used  for  fixed-level 

pruning,  we  call  e  the  threshold  instead  of  1-e  . 

P  P 

Our  combining  is  based  on  the  track  state  distributions.  A  relatively 
simple  method  has  been  chosen  in  which  two  distributions  with  means  m^  and  m2 
are  judged  to  be  combinable  if  I Im^  -  m2 1  I  ^  e^ .  All  hypotheses  with  the  same 
number  of  tracks  are  examined  for  their  pairwise  combinabil ity .  Once  two 
hypotheses  are  combined,  combined  tracks  are  represented  by  Gaussian  distribu¬ 
tions  with  the  appropriate  means  and  variances.  Once  two  tracks  are  combined 
into  one  track  in  this  way,  all  the  hypotheses  which  refer  to  such  tracks  are 
modified  so  that  the  combined  tracks  become  identical  throughout  these 

hypotheses.  Windowing  is  based  roughly  on  the  3- a  principle.  In  our  case, 

% 

data  validation  includes  also  the  radial  velocity  test  and  the  mask  test.  The 
clustering  described  in  Section  7  is  also  used.  However,  only  tracks  with 
probability  one  are  split  from  clusters. 


Figure  9-6  shows  a  data  set  for  a  single  sample  run  described  below.  The 


parameters  are  summarized  as  follows: 


D  =  50  km 
At  =  15  s 
MDV  =  2  m/s 


o  =  3  m 
r 


Oq  =  . 1  rad . 


°RV  “  -2 

=  1  per  scan 


V  =27 
o 


Pd  =  .8 

e  =  5% 
P 


10  m 


distance  between  the  road  and  the  sensor 
scan  Interval 

minimal  discernible  velocity 

range  measurement  error  standard  deviation 

bearing  measurement  error  standard  deviation 

radial  velocity  measurement  error  standard  deviation 

expected  number  of  false  alarms 

expected  total  number  of  targets 

probability  of  detection 

pruning  threshold 

combining  threshold 


The  above  set  of  parameters  is  used  as  the  base  case.  The  effects  of 

varying  three  parameters,  namely,  the  expected  number  v  of  false 

FA 

alarms  per  scan,  the  range  measurement  error  standard  deviation  0^ 

and  the  pruning  threshold  e  are  examined  in  Monte  Carlo  simulations. 

P 

The  results  are  shown  later. 


In  Figure  9-6,  the  actual  target  motions  are  shown  by  lines  (1)  through 
(4).  This  target  scenario  is  also  used  in  the  Monte  Carlo  simulations. 
Targets  (1)  through  (3)  move  relatively  slowly  at  10  m/s  towards  the 
left.  Target  (4)  moves  at  a  higher  speed,  15  m/s,  to  the  right.  Target 
(1)  is  masked  at  scans  0,  1  and  2,  appears  at  scan  3  for  the  first  time, 
and  is  not  detected  at  scan  5  although  it  is  in  the  unmasked  region. 

Target  (3)  appears  at  scan  3  and  is  falsely  dismissed  at  scan  8.  The 
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gure  9-6  A  Sample  Run  -  Targets  and  Measurements 


false  alarms  appear  almost  uniformly  over  the  field  of  view.  All  the 
measurements  (including  false  alarms)  are  shown  in  Figure  8-6  by  their 
projection  on  the  road  using  the  relatively  accurate  range  measurements. 

Figures  9-7  to  9-9  display  the  details  of  the  hypothesis  formation 
process  for  the  data  shown  in  Figure  9-6.  Figures  9-7 (a)  to  9-7 (d)  show 
the  complete  histories  of  several  clusters.  Figure  9-8(a)  to  9-8(g) 
show  the  clusters,  their  hyoptheses  and  tracks  and  the  probabilities  for 
each  scan,  while  Figure  9-9  is  a  summary  history  of  all  the  clusters. 

The  following  is  a  scan-by-scan  description. 

SCAN  0:  There  are  two  measurements:  one  from  target  (2)  and  the 

other  a  false  alarm.  The  ratio  of  the  new  target  likelihood  over  the 

false  alarm  likelihood  determines  the  probability  of  the  new  target 

hypothesis,  =  ^0^1^  0^1  "  ^0^1^’  shown  in  Figure  9-8(a). 

In  Figures  9-8(a)  through  9-8(g),  hypothesis  .  X  J  and  track  are  indexed  bv 

a  J  K  j 

pre-subscript  k,  superscript  i  and  subscript  j,  indicating  the  j-th 
hypothesis  or  track  in  the  i-th  cluster  at  scan  k.  Each  measurement  is 
identified  by  its  measurement  index  (k,j),  indicating  the  j-th 
measurement  at  scan  k. 

The  two  measurements,  (0,1)  and  (0,2)  at  scan  0,  are  almost  equally 
target-like.  The  (local)  probability  of  measurement  (0,1)  originating 
from  a  target,  .753,  is  consequently  almost  the  same  as  that  of 
measurement  (0,2)  in  the  other  cluster,  .781,  Since  there 
is  no  a  priori  cluster,  two  clusters  are  formed  as  shown  in  Figures 
9-7 (a),  9-7 (b)  and  9-8 (a).  In  Figures  9-7 (a)  and  9-7 (b),  each  number  at 
a  node  of  the  tree  represents  the  measurement  association  specified 
by  a  particular  hypothesis.  In  this  tree  representation,  a  positive 


Scan 


! 


(/) 


Measurement 


Clusters  2  and  3  Before  Split 


integer  i  at  a  node  means  that  the  i-th  target  in  a  hypothesis  is 
hypothesized  to  generate  the  measurement  indicated  at  the  top  of  the 
column  which  contains  this  node  (the  node  level  indicator).  This 
indexing  of  targets  is  unique  only  for  a  particular  hypothesis.  A  "0" 
at  a  node  indicates  that  the  particular  hypothesis  hypothesizes  the 
corresponding  measurement  to  be  a  false  alarm. 

At  the  end  of  processing  scan  0  measurements,  there  are  two  clusters, 
each  of  which  has  two  hypotheses.  Therefore,  there  are  four  global 
hypotheses.  The  best  global  hypothesis  has  probability  .588  and 
hypothesizes  two  targets  of  which  one  is  actually  a  false  alarm. 

SCAN  1 ;  There  are  three  measurements.  The  second  measurement, 

(1,2),  falls  in  a  masked  region  and  is  therefore  thrown  away 
immediately  since  it  is  a  false  alarm  with  probability  one.  As  seen  in 
Figure  9-6,  none  of  the  two  remaining  measurements  falls  into  the 
validation  windows  of  the  two  existing  tracks.  As  a  matter  of  fact,  the 
extrapolation  of  the  two  previous  tracks  indicates  that  both  are  in 
the  masked  regions  if  they  ever  exist  as  real  targets.  Therefore,  the 
hypotheses,  their  probabilities  and  tracks  remain  unchanged,  as  shown  in 
Figures  9-7 (a),  9-7 (b)  and  9-8(a)  for  these  two  existing  clusters. 

Two  additional  clusters,  4  and  5,  are  created  from  the  two  measurements 
(1,1)  and  (1,3),  as  shown  in  Figures  9-7(d)  and  9-8(a).  Measurement 
(1,1)  appears  on  the  left  edge  of  the  field  of  view  and  its  radial 
velocity  measurement  indicates  a  rightward  movement.  Therefore,  the 
hypothesis  that  this  measurement  originates  from  a  target  just  coming 
into  the  field  of  view  is  well  supported.  The  probability  of  this 
hypothesis  (actually  the  truth)  is  calculated  to  be  .696. 
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Figure  9-7{c)  Clusters  2  and  3  After  Split  at  Scan 
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Figure  9-8(a)  Hypotbeses/Tracks  (Scan  0  and  1) 
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On  the  other  hand,  the  other  measurement  (1,3)  appears  on  the  left 
edge  of  an  unmasked  region  and  its  radial  velocity  measurement  indicates 
a  movement  towards  the  left.  This  means  that,  if  it  has  originated  from  a 
target,  the  target  must  have  been  in  the  same  unmasked  region  at  scan  0 
but  have  escaped  detection.  The  unlikely  nature  of  this  event  is  reflected 
by  the  relatively  low  probability  of  .36  for  the  new  target  hypothesis 
jXj  in  cluster  5.  In  reality,  tnis  measurement  is  a  false 
alarm. 

Thus,  we  have  four  clusters  each  of  which  has  two  hypotheses. 

Therefore,  we  have  16  (global)  hypotheses.  The  best  hypothesis  has 
probability  .262.  It  contains  two  real  targets  as  tracks  and  one  false 
track.  The  truth  appears  in  the  fourth  best  hypothesis  which  has  only  a 
probability  of  .086. 

SCAN  2 :  There  are  two  measurements,  (2,1)  and  (2,2).  (2,1)  falls 

into  the  validation  region  of  track  of  cluster  4  which 
has  been  initiated  in  scan  1.  This  measurement  is  the  sole 
measurement  which  falls  into  this  validation  region.  Therefore,  the 
hypotheses  in  cluster  4  are  expanded  to  five  new  hypotheses  as  shown  in 
Figure  9-7  (d).  The  best  hypothesis  of  these  five  hypothesizes  that 
measurements  (1,1)  and  (2,1)  originate  from  the  same  target.  Its  probability 
is  .9999449.  The  pruning  threshold  is  .05,  and  hence  the  remaining 
four  hypotheses  are  pruned.  Consequently,  there  is  only  one 
probability-one  hypothesis  left  in  cluster  4.  At 

this  point,  it  has  been  confirmed  that  there  is  at  least  one  detected 
target  with  probability  one. 

On  the  other  hand,  the  remaining  clusters  1,  2  and  5  have  no  track  with  a 
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Figure  9-8(b)  Hypotheses/Tracks  (Scan  2) 
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measurement  in  its  validation  region.  Track  ^ 

in  cluster  1  is  initiated  at  scan  0  and  the  radial  velocity  measurement 
at  that  time  indicates  that  it  should  now  appear  in  an  unmasked  region 
if  it  has  ever  existed  as  a  target.  Since  there  is  no  measurement  which 
supports  this  hypothesis,  the  probability  of  the  one-track  hypothesis 
drops  from  .753  to  .379.  Track  in  cluster  2,  however, 
indicates  that  the  hypothesized  target  is  still  in  the  masked  region. 
Therefore,  there  is  no  change  in  cluster  2  as  shown  in  Figure  9-7  (b). 

Track  in  cluster  5  behaves  similarly  with  the  one-track  hypothesis 

decreasing  slightly  in  probability  from  .36  to  .357. 

Measurement  (2,2)  does  not  appear  in  any  of  the  validation  regions  of 
the  existing  tracks,  and  hence,  a  new  cluster  6  is  created  out  of  it. 

Since  it  does  appear  at  an  unlikely  position  for  a  target  (left  edge  of 
an  unmasked  region  with  a  negative  radial  velocity),  the  probability 
that  this  measurement  originates  from  a  newly  detected  target  is  only  .269. 

There  are  now  16  (global)  hypotheses.  Two  detected  targets  are 
correctly  incorporated  into  two  tracks  in  the  best  hypothesis  whose 
probability  is  .228.  It  does  not  contain  any  false  tracks. 

SCAN  3 ;  There  are  four  measurements.  Target  (1)  and  target  (3) 
are  detected  for  the  first  time.  Up  to  this  point  they  have  been  hiding 
in  zero-detection-probability  zones.  Clusters  1,  4,  5  and  6  have  no 
measurement  which  falls  into  the  validation  regions  of  their  tracks. 

Cluster  4  has  a  probability-one  hypothesis  and  remains  unchanged. 
Tracks  and  in  clusters  1  and  6  predict  that  the  hypothesized 


78 


targets  should  be  masked  and  hence  these  clusters  remain 
unchanged  also.  However,  track  2*^^  in  cluster  5  predicts  that 
the  target  should  appear  in  an  unmasked  region  and  consequently  its 
probability  drops  from  .357  to  .10. 

Cluster  2  has  two  measurements,  (3,2)  and  (3,3),  which  fall  into  the 

validation  region  of  the  only  track  (3,2)  originates 

from  the  newly  detected  target  (1)  while  (3,3)  from  the  previously 

detected  target  (2)  which  is  correctly  identified  in  the  best  hypothesis 

in  cluster  2.  Cluster  2  is  expanded  into  12  hypotheses  as  shown  in 

Figure  9-7 (b).  Out  of  these  twelve,  eight  hypotheses  are  pruned  away 

using  the  5%  pruning  threshold.  The  remaining  four  hypotheses  together 

have  probability  0.95  or  more.  They  are  then  tested  for  their 

combinability .  The  sixth  and  the  eighth  hypotheses  have  one  target  in 

each  while  the  ninth  and  the  eleventh  have  two  tracks  in  each. 

Therefore  the  sixth  is  compared  with  the  eighth,  and  the  ninth  with  the 

eleventh.  By  comparing  the  track  estimates,  the  ninth  and  the  eleventh 

hypotheses  are  judged  to  be  combinable  and  are  combined.  The  four 

tracks  in  these  two  hypotheses  are  combined  into  two  tracks.  Finally, 

the  tracks  in  the  sixth  and  the  eighth  hypotheses  are  modified  according 

2  2  2 

to  this  track  combining.  The  resulting  hypotheses,  3\.  3*2-  ““  3''3 
Shown  In  Figure  9-8(c),  have  probabilities  .634,  .047  and  .319,  respectively. 
The  best  hypothesis  tracks  target  (2)  correctly  but  fails  to  recognize 

the  newly  detected  target  (1).  The  truth  is  preserved  in  the  second 
(locally)  best  hypothesis  with  probability  .319. 
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Figure  9-8(c)  Hypotheses/Tracks  (Scan  3) 
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Other  measurements,  (3,1)  and  (3,4),  are  used  to  create  two  new 
clusters  7  and  8.  Although  (3,4)  originates  actually  from  target  (3), 

g 

the  corresponding  h3TJothesis  has  only  probability  .266. 

The  best  (global)  hypothesis  tracks  two  targets  (2)  and  (h)  correctly 
but  misses  two  targets  (1)  and  (3).  It  does  not  contain  any  false  track 
and  has  a  probability  of  only  .159. 

SCAN  4:  Target  (4)  is  still  masked,  but  targets  (1)  and  (3),  which 
are  all  in  unmasked  regions,  are  detected.  There  is  one  false  alarm 
(4,1)  at  a  position  likely  to  have  a  target. 

Cluster  2  has  two  measurements  (4,2)  and  (4,3)  which  fall  into  the 

2  2 

validation  regions  of  tracks  and  respectively.  Thus,  cluster  2 

is  expanded  as  shovm  in  Figure  9-7 (b)  into  30  hypotheses  which  are  pruned 

down  to  only  one  hypothesis  which  associates  the  measurement  correctly. 

This  probability-one  hypothesis  contains  two  probability-one  tracks, 

2  3 

and  Thus  cluster  2  is  now  split  into  two  clusters:  cluster  3 

3  2 

which  consists  of  track  and  cluster  2  which  now  has  only  track 

8 

Cluster  8  with  hypothesis  indicating  a  target  with 
probability  .266  receives  a  measurement  (4,4)  and  is  expanded  as  shown 
in  Figure  9-7 (d).  As  a  result  of  pruning,  only  one  probability-one 

Q 

hypothesis  ^A^  survives, ref lecting  the  truth  correctly. 

Cluster  4  which  has  one  probability-one  hypothesis  is  unchanged  because 
the  target  is  correctly  predicted  to  be  in  a  masked  region. 

On  the  other  hand,  track  **  in  cluster  1  is  now 

predicted  to  appear  in  an  unmasked  region  but  there  is  no  measurement 
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Figure  9-8(d)  Hypotheses/Tracks  (Scan  4) 
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I  ♦ 


from  its  predicted  position.  Thus,  the  one-track  hypothesis  | 
has  its  probability  of  .379  reduced  to  .109.  This  probability 

assessment  will  remain  unchanged  from  this  scan  on  because  the  track 
predicts  that  the  target  escapes  outside  the  field  of  view  at  scan  3 
(see  Figure  9-7 (a)). 

Clusters  3,  6  and  7,  with  their  best  hypotheses  correctly  dismissing  the 
measurements  as  false  alarms,  remain  unchanged  due  to  the  masking 
effect . 

Cluster  9  is  newly  created  from  measurement  (4,1)  (actually  a  false 
alarm)  which  is  not  validated  by  any  of  the  existing  tracks.  Since  the 
position  of  this  measurement  indicates  a  strong  possibility  of  coming 
from  a  target,  the  one-track  hypothesis  J  has  probability  .621. 

Thus,  the  best  (global)  hypothesis  with  probability  .304  contains  five 
tracks  one  of  which  is  a  false  track.  However,  there  is  no  missed  target. 

SCAN  _5:  There  are  three  measurements.  Two  of  them  are  from  target  2 
and  target  4.  Target  1  is  not  detected.  As  seen  in  Figure  9-6,  about  this 
scan  the  targets  cross  each  other  in  the  one-dimensional  physical  space  on 
the  road.  There  is  no  crossing  in  the  two-dimensional  state  space  and  the 
three-dimensional  measurement  space.  Therefore,  as  seen  in  Figures  9-7 (c) 
and  9-7 (d) ,  there  is  no  confusion  which  is  usually  associated  with  target 
crossing.  As  seen  in  Figure  9-8 (e)  and  9-9,  clusters  5  and  7  disappear, 
l.e.,  the  no-track  hypothesis  is  now  given  a  probability  higher  than  the 
pruning  threshold  in  each  of  these  clusters,  and  a  new  cluster  10  is  formed 
from  a  false  alarm  (3,3). 
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Q 

Hypothesis  in  cluster  9,  which  falsely  indicates  the 
existence  of  a  target,  now  has  probability  .247  instead  of  .621.  Thus, 
the  best  hypothesis  with  probability  .438  now  correctly  indicates  the 
truth  for  the  first  time.  There  are  no  false  tracks  and  missed  targets. 

SCAN  6 :  Targets  (1),  (2)  and  (4)  are  detected  while  target  (3)  is 
masked  and  there  is  no  false  alarm.  As  seen  in  Figures  9-8 (f)  and  9-9, 
hypotheses  declaring  tracks  out  of  false  alarms  have  either  disappeared 
or  becoming  less  probable  rapidly.  Thus,  the  best  hypothesis  has  a 
probability  of  .736  and  indicates  the  truth  correctly. 

SCAN  7 :  Targets  (1),  (2)  and  (4)  are  masked  but  target  (3)  now 
comes  out  of  a  masked  region  and  is  detected.  There  is  one  false  alarm 
(7,1)  but  the  probability  of  the  measurement  originating  from  a  target 
is  less  than  the  .05  pruning  threshold  and  thus  no  new  cluster  is  formed. 
(7,3)  is  from  a  masked  region  and  is  ignored.  Clusters  6  and  9  have  now 
disappeared.  Thus  the  best  hypothesis  has  probability  .891  which  is 
unchanged  for  the  remaining  scans.  This  is  so  because  cluster  1 
remains  unchanged  as  we  have  indicated  before  at  scan  4. 

SCAN  6:  There  is  only  one  measurement  which  comes  from  a  masked 
region,  and  hence  there  is  no  change  in  any  cluster. 

SCAN  £:  All  four  targets  are  detected  and  correctly 
associated  with  the  four  confirmed  (probability-one)  tracks.  One  false 
alarm  appears  from  a  masked  region  and  is  dismissed. 

The  measurements  (9,1)  and  (9,2)  both  fall  into  the  intersection  of  the 

2  ^ 
validation  regions  of  track  in  cluster  2  and  track 

in  cluster  3.  Therefore,  as  shorn  in  Figure  9-7 (c),  these  two  clusters  are 
merged.  Since  each  of  them  has  only  one  probability-one  hypothesis,  the 
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merged  cluster  has  also  one  probability-one  hypothesis  which  is 
This  merged  cluster  is  expanded  into  14  hypotheses  as  shown  in  9-7 (c).  As  a 
result  of  pruning,  however,  only  one  hypothesis  survives  just  as  in  scan  4. 
Thus,  this  merged  cluster  is  split  into  two  clusters  again. 

Figure  9-10  shows  how  the  probability  of  the  best  hypothesir  changes  from 
scan  tc  scan.  After  scan  7,  there  are  only  two  hypotheses.  One  with  proba¬ 
bility  .891  correctly  identifies  all  the  targets  without  any  false  track.  The 
other,  with  probability  .109,  hypothesizes  an  additional  target  which  may  have 
been  detected  at  scan  0,  undetected  at  scans  2  and  4,  masked  at  scans  1  and  3 
and  then  escaping  out  of  the  field  of  view. 

9.5  Monte  Carlo  Simulations 

The  description  of  the  sample  run  is  intended  to  illustrate  some  distinc¬ 
tive  features  of  the  tracking  algorithm  developed  in  this  report  and  how  it 
may  be  implemented.  It  is  necessary,  however,  to  perform  Monte  Carlo  simula¬ 
tions  if  one  wants  to  evaluate  the  performance  of  the  algorithm.  This  is  true 
in  general  for  nonlinear  filtering  problems  for  which  there  is  no  good  ana¬ 
lytic  method  to  predict  the  performance.  It  is  even  more  so  in  this  case  when 
hypothesis  management  techniques  are  used  extensively.  The  fixed  four-target 
scenario  shown  in  Figure  9-6  is  used  for  the  simulation.  The  parameters 
introduced  earlier  are  used  as  a  base  case.  Six  other  cases  are  examined  to 
to  see  the  effects  of  the  three  parameters: 

1)  ^  f  ^  ~  expected  number  of  false  alarms  per  scan 

2)  0^  -  range  measurement  error  standard  deviation, 

and 

3)  e  ^  -  pruning  threshold 
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may  be  considered  to  represent  the  external  condition  or  the  noisi¬ 
ness  of  the  radar-preprocessor  system,  0^,  a  proxy  of  the  measurement  accu¬ 
racy,  and  a  proxy  of  the  computational  resource  limitation  in  implementing 
the  tracking  algorithm.  Seven  cases  including  the  base  case  are  summarized  in 
Table  9-1. 

The  chosen  performance  indices  are:  1)  average  number  of  false  tracks; 

2)  average  number  of  missed  targets;  and  3)  probability  of  perfect  associa¬ 
tion.  For  each  Honte  Carlo  run,  the  best  hypothesis  after  10  scans  is  com¬ 
pared  with  the  truth.  To  do  this,  the  distance  between  the  expected  position 

calculated  for  each  track  and  each  true  target  position  is  calculated.  Then 

if  the  distance  is  less  than  a  pre-specif ied  threshold,  25  m,  the  pair  is 
declared  feasible.  A  maximum  feasible  assignment  is  sought  using  a  modified 
(rectangular)  zero-one  Munkres  algorithm.  A  track  which  is  not  associated 
with  any  true  target  is  declared  as  a  false  track.  Similarly,  a  target  which 
is  not  accompanied  by  any  feasible  track  is  called  a  missed  target.  An  event 

of  perfect  association  is  declared  if  there  is  no  false  track  and  no  missed 

target.  For  each  feasible  pair  in  the  assignment  found  by  the  Munkres  algo¬ 
rithm,  the  square  roots  of  the  mean  squared  position  and  velocity  errors 
are  calculated.  Each  case  Is  examined  by  a  50-run  Monte  Carlo  simulation. 

Table  9-2  summarizes  the  results.  The  results  demonstrate  a  more  or  less 
expected  trend,  i.e.,  the  worse  (the  better)  the  conditions  are,  the  worse 
(the  better)  the  performance  becomes. 

Table  9-2(a)  shows  the  effect  of  false  alarms.  The  performance  as  meas¬ 
ured  by  the  average  number  of  false  tracks,  average  number  of  missed  targets 
and  probability  of  perfect  association  seems  to  respond  to  the  average  number 
of  false  alarms  (1/3,  1  and  3  per  scan)  in  a  direct  way. 
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Table  9-1  Cases  for  Monte  Carlo  Simulation 


^^A 

°r 

e 

P 

Case  0 

Base  Case 

1. 

3.m 

.05 

Case  1 

Low  Vp, 

1/3 

3.m 

.05 

Case  2 

High  Vp^ 

3. 

3.m 

.05 

Case  3 

Small 

1. 

1  .m 

.05 

Case  4 

Large 

1. 

9.m 

.05 

Case  5 

Low  Cp 

1. 

3.m 

.01 

Case  6 

High  Cp 

1. 

3.m 

.1 

'^F'A  Expected  Number  of  False  Alarms  Per  Scan 
Range  Measurement  Error  Standard  Deviation 
Ep  Pruning  Threshold 


Table  9-2  Monte  Carlo  Simulation  Results 
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(a)  Variation  of  False  Alarm  Rates: 


Expected  Number  of  False 
Alarms  per  Scan  (vp^) 

ANFT 

ANMT 

PofPA 

APE 

AVE 

Low:  1/3 

.42 

.26 

.46 

5.50  m 

.259  m/s 

Base  Case:  1 . 

.48 

.58 

.34 

5.63  m 

.276  m/s 

High:  3. 

.66 

1.02 

.14 

5.33  m 

.258  m/s 

(b)  Variation  of  Range  Measurement  Error: 


Range  Measurement  Error 
Standard  Deviation  (o^) 

ANFT 

ANMT 

PofPA 

APE 

AVE 

Small : 

1 .  m 

.46 

.58 

.34 

4.26  m 

.274  m/s 

Base  Case: 

3.  m 

.48 

.58 

.34 

5.63  m 

.276  m/s 

Large: 

9.  m 

.56 

.68 

.30 

9.33  m 

.279  m/s 

(c)  Variation  of  Pruning  Threshold 


Pruning  Threshold  (e^) 

ANFT 

ANMT 

PofPA 

APE 

AVE 

Low:  0.01 

.46 

.16 

.52 

DO 

.275  m/s 

Base  Case:  0.05 

.48 

.58 

.34 

mmm 

.276  m/s 

High:  0.10 

.46 

.90 

.16 

m 

.277  m/s 

ANFT  Average  Number  of  False  Tracks  per  Run 

ANMT  Average  Number  of  Missed  Targets  per  Run 

PofPA  Probability  of  Perfect  Association  (no  false 
tracks  and  no  missed  targets) 

APE  Average  Position  Error  (conditioned  on  correct 
association) 

AVE  Average  Velocity  Error  (conditioned  on  correct 
association) 
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The  mechanism  of  generating  false  tracks  and  missed  targets  can  be 
explained  as  follows.  Suppose  that  a  false  alarm  measurement  (0,1)  shown  in 
Figure  9-6  has  a  negative  radial  velocity  measurement  and  its  position  meas¬ 
urement  is  slightly  more  to  the  left  than  the  one  shown  in  the  figure.  A 
cluster  will  be  formed  out  of  this  measurement  and  the  sole  one-track 
hypothesis  in  this  cluster  very  likely  is  given  a  probability  greater  than  .5. 
This  becomes  a  source  of  a  false  track  no  matter  what  is  done  afterwards 
unless  this  cluster  is  completely  ignored.  Can  one  discard  such  clusters? 

The  answer  is  no,  because  the  calculated  probability  is  consistent  with  that 
of  the  event  of  a  target  generating  one  measurement  and  disappearing  into  the 
zero-detection-probability  zones.  Thus,  the  number  of  false  alarms  is 
directly  related  to  the  number  of  false  tracks. 

On  the  other  hand,  as  we  have  seen  before,  in  order  for  a  sequence  of 
measurements  originating  from  a  target  to  become  a  track  with  enough  probabil¬ 
ity  to  appear  in  the  best  hypothesis,  two  or  three  scans  are  needed. 

Meanwhile,  at  each  scan,  a  large  number  of  hypotheses  may  be  created  if  the 
number  of  false  alarms  is  large.  Then,  as  a  result  of  pruning,  a  target  may 
be  lost  from  the  best  hypothesis.  Therefore,  it  may  be  conjectured  that,  when 
the  sensor  is  noisy  and  produces  a  large  number  of  false  alarms,  more  scans 
are  needed  before  a  conclusion  is  made  and  a  larger  number  of  hypotheses  need 
to  be  preserved.  The  latter  statement  is  actually  supported  by  our  simulation 
runs  using  a  lower  threshold.  The  effect  of  false  alarms  on  the  state  esti¬ 
mate  errors  is  not  significant.  This  is  not  surprising  because  those  errors 
are  calculated  only  for  the  feasible  pairs. 

The  effects  of  range  measurement  error  as  seen  in  Table  9-2 (b)  are  less 
drastic.  There  is  virtually  no  improvement  in  the  basic  performance  indices. 


measured  by  the  average  number  of  false  tracks,  average  number  of  missed  tar¬ 
gets  and  the  probability  of  perfect  association  when  the  range  measurement 
error  is  smaller  than  that  in  the  base  case.  Also,  there  is  no  drastic  per¬ 
formance  degradation  when  the  error  is  larger.  However,  some  degradation  is 
noticed  as  expected,  since  increasing  errors  mean  more  confusion,  more 
hypotheses,  and  more  branch  cutting,  etc.  We  also  note  that  the  effect  is 
more  pronounced  on  the  position  estimation  error  while  the  velocity  estimation 
error  is  not  affected  at  all. 

Table  9-2(c)  shows  the  effect  of  the  pruning  threshold.  The  average 
number  of  missed  targets  is  directly  affected  by  this  parameter,  and  a  drastic 
change  can  be  observed  in  the  table.  The  average  number  of  false  tracks,  how¬ 
ever,  is  not  affected.  This  indicates  that  the  false-track-creating  mechanism 
described  previously  is  dominant  and  cannot  be  improved  by  keeping  more 
hypotheses.  As  in  the  case  c£  varying  the  false  alarms,  state  estimation 
error  is  not  affected  by  changing  the  pruning  threshold. 

It  should  be  noted  that  the  other  performance  indices  AMFT  (average 
number  of  false  tracks),  ANMT  (average  number  of  missed  targets)  and  PofPA 
(probability  of  perfect  association)  all  have  to  do  with  how  well  the  data 
association  has  been  performed.  Of  these  indices,  PofPA  is  the  most  stringent 
since  perfect  association  (given  a  certain  evaluation  threshold)  is  needed. 

For  a  difficult  scenario  such  as  the  one  used  in  the  example,  this  is  hard  to 
come  by.  A  more  reasonable  set  of  figures  to  look  at  are  ANFT  and  ANMT  which 
measure  the  deviation  form  the  ideal  performance.  From  Table  9-2,  we  see  that 
the  GTC  indeed  performs  quite  well  in  isost  cases,  with  ANFT  and  ANMT  less  than 
6Z  and  15Z  of  the  actual  number  of  targets  in  the  base  case. 
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10.  CONCLUSION 


A  general  algorithm  for  Che  tracking  and  classification  of  multiple  tar¬ 
gets  has  been  derived  using  the  Bayesian  approach.  The  models  underlying  the 
algorithms  rely  on  a  fairly  general  set  of  assumptions.  In  most  of  the  exist¬ 
ing  work  on  multitarget  tracking,  there  is  a  certain  vaqueness  in  the  mathema¬ 
tical  development,  especially  when  It  comes  to  modeling  the  number  of  targets. 
In  some  cases  a  certain  birth-death  process  is  implied  about  the  model,  but 
this  fact  has  not  been  used  explicitly  in  the  development.  In  contrast,  our 
basic  approach  to  target  modeling  is  to  start  with  an  explicit  model  on  the 
number  of  targets.  Although  we  have  restricted  our  attention  to  the  case  when 
the  number  of  targets  is  random  but  constant  in  time,  a  time-varying  number  of 
targets  can  be  easily  handled  within  our  basic  framework  either  by  introducing 
an  variable  which  reflects  the  active  or  inactive  state  of  each  individual 
target  or  by  modifying  the  basic  equations  directly.  Another  distinguishing 
feature  of  our  approach  is  the  explicit  modeling  of  the  mechanisms  which  gen¬ 
erate  the  sensor  measurements,  namely,  detection,  random  assignment,  false 
alarm  generation  and  measurement  value  generation. 

The  result  is  an  algorithm  which  is  considerably  more  general  than  what 
has  been  reported  in  the  literature.  It  not  only  can  handle  tracking  and 
classification  simultaneously  in  one  unifying  framework  but  can  also  take  care 
of  unconventional  measurement  situations  such  as  when  terrain  masking  is 
present.  When  restricted  to  i.i.d.  target  models,  which  account  for  most  of 
the  existing  results,  this  algorithm  provides  a  unifying  view  of  comparing  all 
the  common  multitarget  tracking  algorithms.  However,  we  have  not  exploited 
the  full  potential  of  this  approach.  With  some  additional  work,  we  believe 
this  approach  can  handle  more  complicated  target  models,  such  as  targets  mov¬ 


ing  in  a  group,  etc. 


This  work  constitutes  the  theoretical  foundation  for  developing 
estimation-based  processing  algorithms  in  a  DSN.  It  provides  the  necessary 
algorithms  to  be  implemented  at  each  node  for  processing  the  local  sensor 
data  before  communicating  with  other  nodes.  By  looking  at  a  distributed  ver¬ 
sion  of  this  algorithm,  we  can  also  obtain  algorithms  for  the  fusion  of  infor¬ 
mation  from  other  nodes. 

Implementation  issues  are  always  crucial  in  any  tracking  algorithm,  espe¬ 
cially  one  which  relies  on  the  formation  of  multiple  hypotheses.  In  this  par¬ 
ticular  case,  successful  implementation  depends  on  good  hypothesis  management. 
Although  we  have  made  some  progress  in  classifying  and  understanding  the  tech¬ 
niques,  basic  theoretical  results  are  still  lacking.  It  is  believed  that 
advances  will  probably  be  made  through  a  lot  of  experimentation  and  by  using 
techniques  for  tree  searches  from  artificial  intelligence. 
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